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Abstract 

This survey is devoted to the asymptotic behavior of solutions of evolution equations gen- 
erated by maximal monotone operators in Hilbert spaces. The emphasis is in the comparison 
of the continuous time trajectories to sequences generated by implicit or explicit discrete time 
schemes. The analysis covers weak convergence for the average process, for the process itself 
and strong convergence and aims at highlighting the main ideas and unifying the proofs. We 
further make the connection with the analysis in terms of almost orbits that allows for a broader 
scope. 
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Introduction 

Discrete and continuous dynamical systems governed by maximal monotone operators have a great number 
of applications in optimization, equilibrium, fixed-point theory, partial differential equations, among others. 

We are specially concerned about the connection between continuous and discrete models. This connection 
occurs at two levels: 

1. On a compact interval, one approximates a continuous-time trajectories by interpolation of some 
sequences computed via discretization. By considering vanishing step size this construction is used to 
prove existence results and to approximate the trajectories numerically. 

2. Another approximation is in the long term, were we compare asymptotic properties of a continuous 
trajectory to similar asymptotic properties of a given path defined inductively trough a sequence of 
values and step sizes. 

It is important to mention that some estimations (eg. Kobayashi) can be useful for both purposes. 

The literature on this subject is huge but lot of the arguments turn out to be pretty much the same. There- 
fore, we intend to give a concise yet complete compendium of the results available, with an emphasis on the 
techniques and the way the enter in the proofs. 

Most of the properties will be established in the framework of Hilbert spaces since our aim is to emphasize 
unity in terms of tools and approach. A lot of results can be extended but in most of the case under specific 
assumptions. With no aim for completeness, we have included several references to the corresponding results 
in Banach spaces that we think might be useful. 
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The paper is organized as follows: In section 1 we recall the basic properties of maximal monotone operators 
along with some examples. Section 2 deals with the associated dynamic approach. We present the existence 
results for the differential inclusion ii G —Au and global properties of implicit and explicit discretizations. 
Section 3 establishes the convergence of the value f{u) in the case of an operator of the form A = df. In 
section 4 we describe general results on weak convergence: tools, arguments, characterization of the weak 
limits. Section 5 is devoted to weak convergence in average and Section 6 is concerned with weak convergence, 
especially for demipositive operators. In section 7 we present the, mostly geometric, conditions ensuring that 
the convergence is strong. Section 8 deals with asymptotic equivalence and explains some apparently hidden 
relationships between certain continuous- and discrete-time dynamical systems. Finally, section 9 contains 
some concluding remarks. 



1 Preliminaries 

The purpose of this section is to introduce notations and to recall basic results. 
1.1 Maximal monotone operators 

Let H he a, real Hilbert space with inner product (•, •) and norm || • ||. An operator is a set- valued mapping 
A : H =i H whose domain 

D{A) = {ueH : Au ^ 0} 

is nonempty. For convenience of notation, sometimes we will identify A with its graph by writing [u, u*] € A 
for u* e Au. The operator A~^ is defined by its graph: [u,u*] G A~^ if, and only if, [u*,u] G A. 
An operator A: H ^ H is monotone if one has 

{x* -y*,x-y)>0 (1) 

for all [x,x*],[y,y*] € A. 

A monotone operator is maximal if its graph is not properly contained in the graph of any other monotone 
operator. Observe that if A is monotone (resp. maximal monotone) then so are A~^ and if A > 0. 

Lemma 1 Let A be a maximal monotone operator. A point [x, x*] G H x H belongs to the graph of A if, 
and only if, 

{x* — u*,x — u) > for all [u, u*] G A. 

Proof. If [x, X*] G A the inequality holds by monotonicity. Conversely, if [x, x*] ^ A, then the set Au{[a;, x*]} 
is the graph of a monotone operator that extends A, which contradicts maximality. ■ 

An operator A: H ^ H is nonexpansive if one has 

< ||a;-t/|| (2) 

for all [x, X*], [y, y*] G A. Observe that a nonexpansive operator is single- valued on its domain. 
Let / be the identity mapping on H. For A > 0, the resolvent of A is the operator 

J^ = {I + XA)-\ 

Theorem 2 Let A: X ^X. Then 

i) A is monotone if, and only if, is nonexpansive for each A > 0. 

ii) A monotone operator A is maximal if, and only if, I + XA is surjective for each A > 0. 



3 



Proof. 

i) Let A be monotone, [x, x*], [y, y*] € A and A > 0. 
Inequality ([T]) implies 

\\x - y\\ < \\x - y + X{x* - y*)\\, VA > (3) 

which is the non expansiveness of J^. 
Conversely, Q leads to 

X{x* -y*,x-y)+X^\\x* -y*\\^>0 
hence implies ^ by dividing by A and letting A — )■ 0. 

a) It is enough to prove the result for A = 1. Given zq G H, we will find xq £ H such that {y — (zq — xq), x — 
xo) ^ for all [x,y] S A so that maximality of A implies zq — xq S Axq. For [x,y] g A, define the weakly 
compact set Cx,y by 

Cx,y = {xa e H : {y + Xq - zo, X - Xq) > 0}. 

It suffices to show that the family {Cx.y}[x,y]£A has the finite intersection property. To this end take 
[xi, yi] G A for i = 1, . . . ,n. Let A — {(Ai, . . . , A„) : Ai > 0; ~ 1} denote the n-dimensional simplex 

and consider the function / : A x A ^ R given by 

fi\ A*) = E"=i f^iiVi + - ^0, x{X) - Xi) 

with x(A) = ^i^i- Clearly /(•, /^) is convex and continuous while /(A, •) is linear. The Min-max Theorem 
(see, for instance, Theorem 1.1 in [121 Brezis]) implies the existence of AqG A such that 

max /(Aq, u) — maxmin /(A, u) < max/(/i, u). 
Now monotonicity of A implies 

so that /(Ao,/i)<0 for all /iG A, and taking for /i the extreme points we get (yi + xiXo) — zq^x{Xq)~x,i) <0 
for all i, which is a;(Ao)Gn"=i C!xi,yi- 

Conversely, take [m, u*] E H x H such that {u* — i>*, u — w) > for all G A. We shall prove that 

[u, u*] £ A. Since I + A is surjective, there is [v, v*] G A such that v + v* = u + u* . Then {u* — v*,u — v) = 
— ||u — U|p > which implies u = v, u* = v* and [u, u*] £ A. ■ 



Comments 

The study of monotone operators started in [331 Minty]. See also [551 Kato] for part i) in Banach spaces. 
The i/part in ii) holds in Banach spaces, but not the only i/part (see [34l Hirsh]). □ 



1.2 Examples and properties 

Example 1 Let C C H and let T : C ^ iJ be nonexpansive. The operator A ^ I — T is monotone because 

{Ax-Ay,x-y) = \\x - y\\^ - {Tx - Ty, x - y) 

> \\x - y\\ \\x - y\\ - llTa; - Ty\\ 

> 0. 

Maximality depends on whether T can be extended to a nonexpansive function on a set that contains C 
properly (for example if C is closed and convex) . □ 
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Example 2 Let ro(i?) denote the set of all proper, lower-semicontinuous convex functions / : H ^ RU 
{+00}. For / e ToiH), the suhdifferential of f is the operator df : H ^ H defined by 

df{x) ^{x* eH : f{z) > f{x) + {x*,z-x) for aU z e H}. 

To see that it is monotone, take x* £ df{x) and y* e Of{y). Thus 

/(y) > fix) + {x*,y-x) 
f{x) > f{y) + {y*,x-y). 

and adding these two inequalities we obtain {x* — y*,x — y) > 0. For maximality, according to Theorem [2] 
it suffices to prove that for each y E H and each A > there is x\ G D{df) such that y £ x\ + Xdf{x\). 
Indeed, consider the Moreau- Yosida approximation of / at y, which is the function f\ defined by 

f^{x)^ f{x) + ^\\x-yr. (4) 

ft is proper, lower-semicontinuous, strongly convex and coercive (due to the quadratic term and the fact 
that / has a affine minorant). Its unique minimizer x\ satisfies 

Q ^ dfxixx) ^ df{xx) + \{xx~ y). 
That is, yexx + Xdf{xx). □ 



The solution set of A is S = A ^0 = {a; G /f; G Ax}. This set is relevant in optimization and fixed-point 
theory: 

• If A = I — T, where T is a nonexpansive mapping, then S is the set of fixed points of T. 

• If A ~ df, where / is a proper lower-semicontinuous convex function then S is the set of minimizers 
of/. 

Let us describe some topological consequences of maximal monotonicity. 

Proposition 3 Let A be a maximal monotone operator. Then A is sequentially weak-strong and strong-weak 
closed. 

Proof. Take sequences {xn} and {x*} in H such that [a;„,a;*] G A for each n G N and suppose that 
x„ — > a; and x* ^ a:*, as n ^ 00 (consider A~^ for the other case). To prove that [a;, a;*] G A, recall that 
by monotonicity, for all [u, u*] G A and all n G N, (a;* — u*, a;„ — u) > 0. Letting n ^ 00 the convergence 
assumptions imply that (a;* — u* ,x — u) > for all [u, u*] G A. Hence [a;, a;*] G A by Lemma [T] ■ 



Corollary 4 Let A be maximal monotone. For each x G D{A) the set Ax is closed and convex. In particular, 
S is closed and convex. 



Proof. Proposition [3] implies Ax is closed for each x G D{A). To see that Ax is convex, take x*,y* G Ax, 
[u,u*] G Aand A G (0,1). Then (Aa;* + (I - A)y* - u*, a; - u) = X{x* - u* , x - u) -\- (1- X){y* - u* , x- u) > 0. 
As before, we conclude that Aa;* + (I — \)y* G Ax by Lemma [1] Finally, since A~^ is maximal monotone 
and S = A^^O, the set S is closed and convex. ■ 
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2 Dynamic approach 



The following sections address, among others, the issue of finding zeroes of a maximal monotone operator 
A. The strategy is the following: we shall consider some continuous and discrete dynamical systems whose 
trajectories may converge, in some sense and under some conditions, to points in 5 = A~^0. In this section 
we present these systems along with some relevant properties. 

From now on we assume that A is a maximal monotone operator. 
2.1 Differential inclusion 

In this section we consider the following differential inclusion: 

J u{t) e —Au{t) a.e. on (0,00) , . 

{ uiO) = x e DiA). 

A solution of ((5]) is an absolutely continuous function u from R+ to H satisfying these two conditions. 
Monotonicity implies the following dissipative property: 

Lemma 5 Let ui and U2 be absolutely continuous functions satisfying Ui{t) G —Aui{t) almost everywhere 
on (0,T). Then the function 1 1— > ||wi(t) — it2(i)|| is decreasing on (0,T). 

Proof. For t S (0,T) define e{t) = l\\ui{t) - U2(t)P- The hypotheses give e{t) = {ui{t) - U2{t),ui{t) - 
U2{t)) < for almost every t. ■ 

Immediate consequences are the following: 

Corollary 6 Let y (z S and u be a solution of ([5]). Then lim \\u{t) — y\\ exists. 

t — ^00 

Corollary 7 There is at most one solution of ([5]). 
Another aspect of dissipativity is the following: 
Proposition 8 is decreasing. 

Proof. Lemma [5] implies that for any h > and s < t 

\\u{t + h)- u{t)\\ < \\u{s + h)- it(s)|l 
hence the result by dividing by h and taking the limit as h 0. ■ 



We shall present two approaches for the existence of a solution of ([5]) . The first one uses the Yosida approxi- 
mation and is the best-known in the theory of optimization in Hilbert spaces. The second one uses proximal 
sequences to approximate the function u. It is popular in the field of partial differential equations since it 
works naturally in arbitrary Banach spaces. 

But before doing so, and assuming for a moment that the differential inclusion ([5]) does have a solution, 
observe that by Lemma [5l for each t > the mapping x i— > u{t) defines a non expansive function from D{A) 
to itself that can be continuously extended to a map St from D{A) to itself. The family {5f}f>o is the 
semi-group generated by A and satisfies: 

i) So = I and St o Sr = St+r, 
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ii) \\Stx~Sty\\ < \\x~y\\; 

iii) lim lla; — Stx\\ = 0. 

Reciprocally, given a continuous semi-group of contractions i.e. satisfying i), ii) and iii), from a closed convex 
subset C to itself, there exists a generator, namely a maximal operator A with C — D{A) such that Stx 
coincides with u{t) for x G D{A), see [TOl Brezis]. 

We will use hereafter both notations u{t) and StX. 

2.2 Approach through the Yosida approximation. 

2.2.1 The Yosida Approximation 

Recall that the resolvent is J^. The Yosida approximation of A is the single- valued maximal monotone 
operator Ax, A > 0, defined by 

A, = j{I-J^). 

Since is nonexpansive and everywhere defined, A\ is monotone (see example 1 above) and maximal (using 
Lemma[T]). It is also clear that Ax is Lipschitz-continuous with constant 2/ A. Observe that S = A^^O = A^^O 
for aU A > 0. 

For a closed convex set C d H and a point x (z H we denote by Pcx the orthogonal projection of x onto 
C. The minimal section of A is the operator A'^ defined by A'^x = Pa^O, which is clearly monotone but not 
necessarily maximal. 

The following results summarize the main properties of the resolvent and the Yosida approximation. They 
can be found in [19, Brezis] (see also ^ISj Barbu] for Banach spaces). 

Proposition 9 With the notation introduced above we have the following: 

1. Axx e AJ^x 

2. \\Axx\\ < \\A'^x\\, \\Axx\\ is nonincreasing in A and lim 

A — >0 

3. lim J^x = X. 

A^o ^ 

4-. If xx ^ X and Axxx remains bounded as A — )■ 0, then x G DiA). Moreover, if y is a cluster point of 
Axxx as X 0, then y G Ax. 

5. A'^ characterizes A in the following sense: If A and B are maximal monotone with common domain 
and A° = B° , then A = B. 

6. lim Axx = A'^x and D{A), the (strong) closure of D{A), is convex. 

2.2.2 The existence result 

The main result is the following: 

Theorem 10 There exists a unique absolutely continuous function u : [0, +oo) H satisfying ([5]). More- 
over, 

1. iiE L°°{0,oo; H) with \\u{t)\\ < \\A'^x\\ almost everywhere. 

2. u{t) G D{A) for allt>0 and \\A"u{t)\\ decreases. 

3. A^u{t) is continuous from the right and u(t) admits a right-hand derivative for all t > 0; namely 
u(t+) = —A'^u{t) (lazy behavior) 
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The problem of finding a trajectory satisfying ^ was first posed and studied in [351 Komura] and [SSI 
Crandall and Pazy] . The classical proof can be found in [T9^, Brezis] . The idea is to consider the differential 
inclusion ([5]) with A ~ Ax , which has a solution ux by virtue of the Cauchy-Lipschitz-Picard Theorem. Then 
one proves first that, as A 0, ux converges uniformly on compact intervals to some u, then that u satisfies 
([5|) for the original A. The following estimation plays a crucial role in the proof and is interesting on its own: 

\\ux{t)-u{t)\\<2W{uo)\\Vxi. (6) 

Finally u is proved to have the properties enumerated in Theorem 1 101 

Comments 

The same method can be extended to Banach spaces X such that X and X* are uniformly convex (see [35l 
Kato]). □ 



2.3 Approach through proximal sequences. 
2.3.1 Proximal sequences 

Let {A„} be a sequence of positive numbers or stepsizes. {a;„} is a proximal sequence if it satisfies 

I ^'^"-^ (= -Axn for all n > 1 
I " Xo e DiA). 

In other words, 

X„ = (/ + XnA)-^Xn-l = Jt^n-l- (8) 

The existence of such a sequence follows from Theorem [2] Observe that the first inclusion in ^ can be seen 
as an implicit discretization of the differential inclusion ([S]), called also a backward scheme. The velocity at 
stage n is 

Vn = T • 

Comments 

The notion of proximal sequences and the term proximal were introduced in [451 Moreau] for A = df. In 
that case, finding Xn corresponds to minimizing the Moreau- Yosida approximation of / at Xn-i (see Q), 
namely 

/a„(2;) = f{x) + — ||x-a;„_i||^ 

□ 



Monotonicity implies the following properties: 
Lemma 11 The sequence \\yn\\ is decreasing. 

Proof. The inequality (y„ - x„ - x„_i) < implies (y„ - yn-i,yn) < and therefore ||j/„|| < 
■ 

This is the counterpart of ||u(t)|| decreasing. Proposition HI 
Lemma 12 Let x £ S. Then ||x„ — x\\^ + A^J|j/„|p < ||a;„_i — x\\^ . 
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Proof. Simply observe that 

4' = I 

\2|i , ||2 I 11 \\2 



•^n—l ■^11 1 1 -^n — 1 -^n 1 1 1 1 '^n || 2 Xji , Xn x) 



> •^rill2/«ll +l|a;n-a;|| 

since (a;„_i — a;„, x„ — x) > by monotonicity when x is in S. ■ 
An immediate consequence is the following: 

Corollary 13 Let x £ S. The sequence ||a;„ — xjp is decreasing, thus convergent. 
Notice the similarity with Corollary [6l 

2.3.2 Kobayashi inequality 

The following inequality, due to Kobayashi [36j , provides an estimation for the distance between two proximal 
sequences {xk\ and with stepsizes {A^} and {A;}, respectively. 
We use the following notation throughout the paper: 

k k 

CTfc = ^ Aj and = ^ A^ 

i=l i=l 

(similarily for ai and ti). 

Proposition 14 (Kobayashi inequality) Let {xk} and {xi] he two proximal sequences. If u E D{A), 
then 

\\xk~xi\\ < \\xo-u\\ + \\xo~u\\ + \\A°u\\y/{ak-di)^ +Tk+?i. (9) 
We first prove the following auxiliary result: 
Lemma 15 Let [ui, vi], [u2, ^2] G A and A, /i > 0, then 

(A + ^i)\\Ul - W2II < A||U2 + M«2 - Will + A*lki + ^^1 - W2||- 

Proof. Write u ~ ui ~ U2. Then 

(A + ^)||U1 - M2IP = \{U2 - Ul,-u) + fj,{ui - U2,u) 

— \{U2 + ^J.V2 — Ui,—u) + fl{ui + Xvi — U2, u) 

+ X^{V2 — Vi,Ui — U2) 
< [X\\U2 + ^V2 - Mill + /i||Ml + Xvi - U2II] ||wi - U2II 

by monotonicity. ■ 
Proof of Proposition I14t To simplify notation set 



:j = \/io-k -m)^ + Tfc + n. 



The proof will use induction on the pair (fc, /). 

First, let us establish inequality ([9]) for the pair (fc,0) with fc > 0. Monotonicity implies, using ([3]) that 

||xi-u|| < \\xo-u- XiA"u\\ 



9 



and 

Inductively we obtain 
thus 



\\xi - u\\ < \\xo - u\\ + Ai||A%|| 
\\xk-u\\ < \\xo-u\\ +ak\\A^u\\ 



\\xk-xo\\ < \\xk-u\\ + \\u-xo\\ 

< \\xo - u\\ + crk\\A°u\\ + \\xo ~ u\\ 

< \\xo - u\\ + \\xq - u\\ + Ck^o\\A°u\\ 

because ak < Ck^. In a similar fashion we prove the inequality for (0, 1) with I > 0. 
Now suppose holds for (fc — 1,1) and (fc, Z — 1). According to Lemma 

(Afe + A;)||a;fe - < Xk\\xi + Xiyi - Xk\\ + A;||a::fc + XkVk - 

Setting ak,i = and [3k.i = 1 — ak,i = we have 

Afe + A; Afe + A; 

\\xk-xi\\ < ak^i\\xk-^i -xiW + PkdW^i-i - XkW 

< ak,i [\\xq - u\\ + po - u|| + Cfe_ij||A"M||] 

+Pk,i [\\xo - u|| + \\xo - u|| + Cfc,;_i||A°u|l] 
= \\xo-u\\ + \\xa-u\\ + [akdCk-i.i+ l3k,iCkd-i]\\A°u\\. (10) 

It only remains to verify that 

0ik,iCk^i,i + Pk,iCk,i-i < Ck,i- (11) 

Cauchy-Schwartz Inequality implies 

ak,ick-i,i + (3k,ick,i-i = aJ^{a]/^Ck-i,i) + Ckj-i) 

= {o^k,ici^i,i + Pkjcii_^y^^ . 

On the other hand, notice that c1_-^ ^ — c\i — 2Xk{ak — ^i), while c| i_i — i + '2-Xi{(Tk — di). Hence, 

iak,iCk~id + (3k.iCk.i~i)'^ < (^k,ici-i,i+ Pk,ic\j_i 

= ak,icl I + Pk,ic\ I - 2{ak,iXk - Pk,iXi){<^k - <?;) 



Cfej 



Inequalities (dO]) and (HI]) give dH). 



Comments 

Kobayashi's original inequality also accounts for possible errors in the determination of the proximal sequence, 
see [36]. Nonautonomous version of the inequality can be found in [?, Kobayasi, Kobayashi and Oharu] [21 
Alvarez and Peypouquet]. □ 
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2.3.3 The existence result 

In general Banach spaces, existence and uniqueness can also be derived by the method in [28j Crandall and 
Liggett], based on the resolvent, which we now present: 

Set t € [0, T], m S N and consider a proximal sequence with constant stepsizes Xk = t/m. The m-th iteration 
defines a function 

Repeat the procedure for each m to obtain a sequence {u„i{t)} of functions from [0, T] to H. The following 
result was proved in [551 Crandall and Liggett]: 

Theorem 16 The sequence {um{t)} defined above converges to some u{t) uniformly on every compact in- 
terval [0,T]. Moreover, the function t i— s- u{t) satisfies ([5]). 



Proof. Instead of the original proof we present an easier one using Kobayashi's inequality ([QIlj. Fix 
N, M G N and t,s G [0, T] with T > 0. Consider two proximal sequences with Xk ~ t/N and A; — s/M for 
all Initialize Xk and xi both at x. Note that xn — UN{t) and xm — uai{s) hence 



\\uN{t) - um{s)\\ < \\A"x\\^J{t~sy^ + ^ + 



M ■ 



Thus the sequence converges uniformly on [0, T] to a function u, which is uniformly Lipschitz-continuous 
with constant ||v4°a;||. 

In order to prove that the function u satisfies ([5|) it suffices to verify that it is an integral solution in the 
sense of Benilan [T7], which means that for all [x, y] E A and < > s > we have 

i [\\u{t) -xr- \\uis) - xr] < J\y,x- u(r)) dr. (12) 

Since u is absolutely continuous, implies u{t) £ —Au{t) almost everywhere on [0,r]. 

Monotonicity of A implies that for any proximal sequence {xk}- {xk-i — Xk — Xky,Xk — x) > 0. But 

\\xk - - ||a;fc-i - < 2{xk^i ~ Xk,x- Xk) and so 

\\xk - x\\'^ - \\xk-i - x\\'^ < 2Xk{y,x - Xk). 

Summing up for k = m + 1, . . .n we obtain 



\Xn- xW"^ - \\xo - xW"^ <2^Xk{y,x - Xk). 

fc=i 



Setting xo = u{s) and passing to the limit appropriately we finally get p^ . Notice that u{t) e D{A) by 
maximality. H 



A consequence of Proposition [14] and Theorem [T6| is the following 

Corollary 17 The following statements hold: 
i) For each z G T){^A) we have 

\\xn - u{t)\\ <\\xo~ z\\ + \\u{0) - z\\ + ||A0z||VK-t)2+' 



^In fact, Kobayashi's proof is based on a simplification of Crandall and Liggett's method. 
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ii) For trajectories u and v we get 



\\v{s) ~ u{t)\\ < \\v{0) - z\\ + \\u{0) - z\\ + |s - t\. 

in) The unique function u satisfying ([5]) is Lipschitz- continuous with 

\\u{s)^u{t)\\ < \\A°x\\ \s~t\. 

iv) ii G L°°(0, cxd; with \\u(t)\\ < \\A'^x\\ almost everywhere. 

Proposition [14] was used to construct a continuous trajectory by considering finer and finer discretizations on 
a compact interval. By controlling the distance between two discrete schemes it is possible to obtain bounds 
for the distance between a limit trajectory and a discrete scheme. As a consequence, one can estimate the 
distance between two trajectories as well. 

2.4 Euler sequences 

Assume A maps D{A) into itself. (Notice that this is a strong assumption, so the range of applications 
of this discretization method is limited compared to the proximal sequences). Let {A„} be a sequence of 
positive numbers or stepsizes. Define an Euler sequence {zn} recursively by 

" ^ e —Azn-i for all n > 1 



A„„i - (13) 

zo e D{A) 

A remarkable feature of this scheme is that the terms of the sequence can be computed explicitly (forward 
scheme) . 

Observe that if A = / — T with T noncxpansive and A„ = 1 then z„ = T'^zq. This particular case has 
been studied extensively by several authors in the search for fixed points of T. Some of their results will be 
presented in the forthcoming sections. 

Note also that in this framework a Kobayashi-type inequality holds too, namely 



\\zk - zi\\ < \\za - u\\ + \\zo - u\\ + \\u - T{u)\\^/{ak - ^if + tu +ti, (14) 
where u is any point in H. This fact was recently pointed out by [601 Vigeral]. 

Let us define the velocity at stage n as Wn = — G —Azn- 

Lemma 18 If y e S then \\z„+i — < \\z„ — + A^J|w„|p. 

Proof. For any y G H one has 

\\Zn+l - 2/|P = \\z„ - y|P + 2Xn{Wn,Zn - J/) + A^||w„|j^. (15) 

The desired inequality follows from monotonicity if G Ay. ■ 

Observe the similarity and the difference with ([5]) and 0. The dissipativity condition in Lemma [T5] is much 
weaker than the corresponding ones in Lemmas [5] and 1121 

An immediate consequence is the following: 

Corollary 19 Assume ||zn+i — ZnW^ < oo. For each y G S the sequence ||z„ — y\\ is convergent. 
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Proof. It suffices to observe from Lemma [T51 that the sequence Wzn — yW^ + J^m^n W^m+i — ZmW^ is decreasing 



Comments 

The hypothesis in the previous result holds if {A„} € i'^ and bounded. 



□ 



Notice the similarity with Corollaries [6] and [T3l 

The main drawback of Euler sequences is that they can be quite unstable. Most convergence results need 
regularity assumptions such as {A„} G and the boundedness of the sequence {ui^}, or at least that 
INn+i - z„P < oo. 

An important result involving an operator A of the form I — T is the following, see |19| Brezis] : 
Proposition 20 (Chernoff's estimate) Let T he non-expansive from H to itself and A > 0. If v satifies 



with v{0) = vo then 



m = -j{i-T)v{t) 



\\v{t)-r'vo\\ < \\vm\V^t + {nx-ty 



Proof. It is enough to consider the case A = 1. 

Define (/)„(t) = ||w(t)-r"uo|| and7„(t) = \\v{0)\\^yt + [n - t]'^ . We shall prove inductively that (t) < 7„ {t) . 
For n = simply observe that 



\\v{t)-vo\\< / \\v{s)\\ds<\\m\\t<loit) 
Jo 

using point 4 in Theorem [TOl 

Now let us assume 0„_i < 7,1-1 and prove <pn < 7n. Multiplying v{t) + v(t) — Tv{t) by e* and integrating 
we obtain v{t) ~ voe~* + e'*~*^Tw(s) ds so that 



(«o-r"«o)+ / e(^-*)[rt;(s)-r"t;o]rfs 



< e-*||«o-T"«o|| + / e^'''Un-i{s)ds 



Noting that \\vo - r"uo|| < T,"=i \\T'~^va - T'vq\\ < n\\vo - Tvq\\ = n\\v{0)\\ and using the induction 
hypothesis we deduce 



Hence it suffices to establish the inequality 



n||i>(0)|| + / e«/S,_i(s)ds 




+ / eVs + [{n - 1) - s]2 ds < e*y/t + [n - t^ 



Since this holds trivially for t = 0, it suffices to prove the inequality for the derivatives 



e*'^y/t+[{n^l)-t]'^ < e* 



y/t+[n- t]2 + 



1 - 2[n - t] 
2y^t+[n-tY 
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This easily verified by squaring both sides. 



In particular if T is the resolvent J^, v is u\ and using ([6]), we deduce that 

+ \Ayx~u{t)\\ < \\A"{uo)\\ (2Vxi + y/ \t + [nX - t)^'^ (16) 
hence taking X = t/n we obtain an exponential approximation 

(^I+-Aj x~~u{t) 

2.5 Discrete to continuous 

Given a sequence {a;„} in X along with a strictly increasing sequence {iTn} of positive numbers with uq = Q 
and cr„ — !■ oo as n ^ oo, one can construct a "continuous-time" trajectory x by interpolation: for t G 
[(T„,cr„+i], take x(t) anywhere on the segment [a;„,a;„+i]. It is easy to see that any trajectory defined this 
way converges to some x if, and only if, the sequence {x„} converges to x. 

Observe that if the interpolation is chosen to be piecewise constant in each subinterval [cr„, cr„+i), then 

1 /■* 1 " 

tJo ^ 

where X^ ^ c^k ^ cTfc-i- The sum on the right-hand side of the previous equality represents an average of the 
points {xji} that is weighted by the sequence {A„} and will be denoted by i„. 

Prom now on we will consider only proximal or Euler sequences with stepsizes {A„} ^ 

The next sections are devoted to the asymptotic analysis. We start by considering the sequences of values 
in the case A = df in Section 3. The rest deals with the behavior of trajectories and sequences themselves. 
Section 4 presents general tools related to weak convergence and properties of weak limit points. These 
last properties are easier to satisfy for the averages and are studied in Section 5. In Section 6 we present 
weak convergence, in particular in the framework of demipositive operators. Section 7 introduces different 
geometrical conditions that are sufficient for strong convergence. Section 8 is devoted to almost orbits and 
describes equivalence classes that allow to recover previous results with a new perspective and extend to non 
autonomous processes. 

3 Convex optimization and convergence of the values 

This section is devoted to the case A — df where we evaluate / on trajectories. 
3.1 Continuous dynamics 

When A = df with / G ^q{H) the differential inclusion ([5]) is a generalization of the gradient method, for 
nondifferentiable functions. In what follows let u : [0, oo) — > iJ be the solution of the differential inclusion 

u{t) e -df{u{t)), (18) 

whose existence is given in Theorem [TOl Let 

/* = inf fix) e RU {-(»}. 

The following result and its proof are essentially from [19, Brezis] (see [321 Giiler]). 



< 3 



\A"{uo)\\t 



(17) 
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Proposition 21 The function t >—>■ f{u{t)) is decreasing and lim f{u{t)) ~ /*. 

t — ^oo 



Proof. The subdifferential inequality is 

fiuit)) - f{u{s)) < -{uit),uit) ~ u{s)). 

Thus 

m.sup^(-(^»"^("(-»<HI^WlP 

and so the function t i-^ f{u{t)) is decreasing. For each z £ H and s e [0, i] the subdifferential inequality 
then gives 

fiz) > finis)) + {uis),uis) ~z)> fiuit)) + —Ms) - zf. 
Integrating on [0, t] we obtain that 

tfiz)>tf{u{i:)) + \\\uit)-zf-\\\uiQ)-zr 

and so 



for every z £ H. 



Comments 

Inequahty (fT9| shows that if 5 7^ then /(^(t)) converges to /* at a rate of 0{l/t). However, if the 
trajectory is known to have a strong limit, then the rate drops to o{l/t) (see [32j Giiler]). 

□ 



3.2 Proximal sequences 

Let {xn} be a proximal sequence associated to A ^ df . The following result is due to [311 Giiler]: 
Proposition 22 The sequence /(x„) is decreasing and lim /(a;„) — /*. 



Proof. The subdifferential inequality implies /(a;„_i) — f{xn) > A„||y„||^ so that /(I'n) is decreasing 
Convergence of f{xn) to /* follows from Lemma [23] below since cr„ ^ 00. I 



Lemma 23 Let u S domf , then 



\\u - a;o|P 11m - a;„|p o-„ 



/(a;n) - fiu) < — -\\y: 



Proof. The subdifferential inequality is 

(li Xji^ Xji—l x^ 



fiu) - f{x„) > {u- Xn,-yn) 



An 

for all u in the domain of /. Thus 
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2Xnif{u)- fiXn)) > \\u~Xnf+Xl\\ynf-\\u-Xr,-l\\\ 

Summing up from 1 to n leads to 

n n 

2anf{u) - 2^ Afc/(xfc) > \\u - x^f + ^ Xlhkf - \\u - xof. (20) 

k=l k=l 

On the other hand the subdifferential inequahty hiipUes /(x„_i) — /(a;„) > A„||?/„|p. Muhiplying by cr„_i 
and rearranging we get 

n'^n— ill II ; 

from which we derive 

n n 

-CTnfiXn) + ^ Xkf{Xk) > ^ AfeCTfc_ 1 1 1 J/fc || ^ 
fc=l k=l 

by summation. Adding twice this inequahty to (j20[) we obtain 

n n 

2a„(/(ii) - /(x„)) >\\u- a;„||2 -\\u-xo\\^ + Y^ >^l\\yk\\^ + 2^, ^k<Jk-i\\yk\\^ ■ 

k=l k=l 

Recall from Lemma fTTl that ||j/„|| is decreasing. We get 

n n 

llynllM = Il2/„f ^(A?. + 2A,a,_i) < Y^{\l+2\kak-,)\\vkr 

k=l k=l 

and the result follows at once by rearranging the terms. H 



Comments 

If 5 7^ 0, Lemma [23] gives 

II II ^ d{xo,S) 

WVnW < ■ (21) 

A similar estimation had been proved in [201 Brezis and Lions] but the right-hand side is ^/2 times larger. 

The fact that f{xn) f* had first been proved in [151 Martinet] when / is coercive and A„ = A. 

By Lemma [23l if 5 7^ the rate of convergence can be estimated at 0(l/cr„). Moreover, ([2T|) and the 
subdifferential inequality together give 

fiXn) -r< {X* - Xn,~Vn) < \\x* - X„|| ||y„|| < d{xo^S)\\x* - X^\\ 

for all X* e S. Therefore, if the sequence {a;„} is known to converge strongly, then \ f{xn) — f*\= o(l/cr,i)- 
This was proved in 131', Giiler] using a clever but unnecessarily sophisticated argument instead of inequality 
([2D. ' □ 



3.3 Euler sequences 

In this case the sequence f{zn) need not be decreasing. However, we have the following: 
Lemma 24 // either ^ H^^n+i ~ 2„||^ < 00 or lim A„||w„|p = 0, then liminf /(z,i) = /*. 
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Proof. Since —Wn G df{zn), the subdifFerential inequality and together imply 

\\Zn+l -y\\'< \\Zn - yf - 2A„(/(2/) - f{Zn)) + (22) 

for each y G H. If ll-^^n+i ~ < oo then 

^A„(/(z„) -/(y)) <oo 
(possibly — oo). Since {A„} ^ one must have liminf f{zn) < f{y) for each y E H. 

n — *oo 

On the other hand, inequality (|22p can be rewritten as 
A„ 

so that 



2(/(^n) - /(y)) - A„||m„||2 < ||2„ _ _ ||^„+, _ y|| 



n 

\\Wn\\'^) < CO 



and liminf f{zn) < f{y) for each y E H. 



A complementary result is the following from 59, Shor] 



Proposition 25 Let dim{H) < oo and assume S is nonempty and compact. If lim A„ = and the sequence 

n — ^oo 

Wn is bounded then lim f{zn) — /*• 



Proof. By continuity, it suffices to prove that dist(z„,5) ~ infj^g^ ||z„ — ?/|| tends to as n — > oo. For 
7 > /* define = {x : f{x) = 7}. Take e > and define 

(5(e) — mindist(y, L/»+e) and d{e) ~ maxdist(y, Lf*^^). 
yes yes 

Observe that < (5(e) < d{e) — > as e ^ 0. By hypothesis and Lemma [24] there is S N such that 
/{zn) < /* + e and A„||w„|| < S{e) for all n > N. We shall prove that dist(z„,5) < 2d{e) for all n > N. 
Since e > is arbitrary this shows that lim dist(z„,5) — 0. 

n — >oo 

Indeed, if /(z„) < f*+e (this holds for n ~ N) then dist(2;„, 5) < d{e) and dist(z„+i, 5) < d{e)+S{e) < 2d{s). 
On the other hand, if f{zn) > /* + e then dist(z„+i,5) < dist(z„,iS). To see this, notice that ii y G S then 
( ||^"|| , y — Zn) is the distance from y to the hyperplane n„ ~ {x : (w„, z„ — a;)}, so that 

{w„,y-Zn) > ||?i;„||dist(5,n„) > ||w„||dist(5, L/(2„)) > ||w„||(5(e), 

where the second inequality follows from convexity and the last one is true whenever f{zn) > f* + s. Using 
and recalling that A„||w„|| < (5(e) we deduce that 



dist(z„+i,5)^ < dist(z„,5)^ - A„|| w„||(5(e), 
proving that dist(z„+i,5) < dist(z„,5). 



Observe that this result does not require the stabilizing summability condition but it is necessary to make 
a very strong assumption on the set S. 
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4 General tools for weak convergence 

We denote by fi[u(i)] (resp. ri[a;„]) the set of weak cluster points of a trajectory u{t) as i ^ oo (resp. of a 
sequence {x„} as n ^ oo). 



Given a trajectory u(t) we define 



1 







Similarly, given a sequence {xn} in H along with stepsizes {A„} ^ we introduce 

f " 

Xn — / X^Xfi;. 

" k=l 

4.1 Existence of the limit 

Most of the results on weak convergence that exist in the literature rely on the combination of two types of 
properties involving a subset F d H: 

The first one is a kind of "Lyapounov condition" on the sequence or the trajectory like 
(al) \\xn — u\\ converges to some £{u) for each u G F, or 

(a2) Pp{xn) converges strongly (in all that follows F will be closed and convex). 
These properties imply that the sequence is somehow "anchored" to the set F. 

The second one is a global one, concerning the set of weak cluster points of the sequence or trajectory: 

(b) n[xn] C F. 

However, it is sometimes available only for the averages: 

(b') n[xn] c F. 

The following result is a very useful tool for proving weak convergence of a sequence on the basis of (al) 
and (b) above. It is known, especially in Hilbert spaces, as Opial's lemma [47j . 

Lemma 26 (Opial's Lemma) Let {xn} be a sequence in H and let F <Z X . Assume 

1. \\xn — u\\ has a limit as n oo for each u £ F ; and 

2. n[xr,] C F. 

Then Xn converges weakly to some x* G F. 

Proof. Since is bounded it suffices to prove that it has only one weak cluster point. Let x,y £ ri[a;„] C 
F so that \\xn — x\\ converges to £{x) and similarly for y. From 

\\xn - y\\^ = \\x„ - x\\^ + \\x - y|p + 2{x„ -x,x-y) 

one deduces by choosing appropriate subsequences 

l{y)=l{x) + \\x-yf (a;0(„)^a;) 

and 

£{y) l{x) - \\x - y\\^ {x^(n) ^ v) 
hence x = y. H 
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Comments 

A Banach space X satisfies Opial's condition if it is reflexive and 

limsup \\xn — x\\ < limsup \\xn ~ y|| wlienever Xn ^ x ^ y. (23) 

n — >oo n — >QO 

liolds. Any uniformly convex Banach space having a weakly continuous duality mapping (in particular, 
any Hilbert space) satisfies Opial's condition (see [171 Opial]). Opial's Lemma holds in any Banach space 
satisfying Opial's condition. □ 



Following 48, Passty], one obtains a more general result: 

Lemma 27 Let be a sequence in H with stepsizes {A„} and let F C X. Assume (al) ; the sequence 

\\xn — u\\ has a limit as n oo for each u F. Then the sets ri[a;„] H F and il,[xn] H F each contains at 
most one point. In particular if n[xn] C F (resp. VL[xn]), then Xn (resp. Xn) converges weakly as n ^ oo. 
A similar result holds for trajectories. 



Proof. Write 

Ikn - = ll^^n - + ll^; - yW^ + 2(a;„ - x,x-y) 

So that {xn, X — y) converges to some m(x, y) for any x,y € F. If it and v belong to ri[a;„] H F one obtains 
{u, u — v) = {v,u — v) hence u = v. Similarly (x„, x — y) converges to m{x, y). Thus both Q.[xn] H F and 
r2[a;„] n F contain at most one point. I 



An alternative proof using (a2) and either (b) or (b') is as follows: 

Lemma 28 Let {a;„} he a hounded sequence in H with stepsizes {Xn} and let F <Z X he closed and convex. 
Assume (a2); PpXn —^C'^sn—f oo. Then 

n[xn] nF = n[xn] n f = {c}. 

In particular, ifQ[xn\ C F (resp. fl[xn]), then a;„ (resp. Xn) converges weakly to A similar result is true 
for trajectories. 



Proof. By definition of the projection, for each u E F one has 

{Xn - PpXn, U - PpXn) < 0. 

Since Xn is bounded we deduce that 

{Xn -C,U-C) < Pn 

with lim Pn — 0. This implies ri[a;„] H F — {^} (if v e ^^[xn] n F, take u — v). Similarly 

n — *oo 

{Xn -C,U-() < Pn, 

which gives il[xn] r\ F = {(}. 

In our case the set F will always be S, which is closed and convex. 
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4.2 Characterization of the hmit: the asymptotic center 

We show here that moreover the weak hmit can be characterized. 



Given a bounded sequence {xn} let 

G{y) = hmsup ||2;„ - y\\^ 

n — 'oo 

(for a trajectory u{t) define G{y) = hmsup \\u{t) — The function G{y) is continuous, strictly convex and 

t — >oo 

coercive. Its unique minimizer is called the asymptotic center (see |30j ) of the sequence (resp. trajectory) 
and is denoted by AC{xn} (resp. AC{u{t)}). 

Observe that, by virtue of Opial's condition ((23)) . ii Xn x then x — AC{xn}- 

The weak limit of the average is still the asymptotic center, under some assumptions. 

Proposition 29 Assume (al). If Xn ~^ x £ F, then x = AC{xn}- 
The same property holds for trajectories. 

Proof. For each y G H we have 

\\xn - xW^ = \\xn - y|P + 2{xn - y,y - x) + \\y - 

Hence 

XmWXm - x\f = Xrn\\Xrn - 2/||^ + 2(S„ - y,y - x) + \\y - 

m — 1 m—1 

li Xn ^ X and x £ F then £{x) — lim ||a;„ — a;|| exists. Therefore, 

~\\x-yr<G{y)-\\x-yr 
for each y £ H so that x — AG{xn}- B 



G{x) = (.{xf < lim sup 



1 

m—1 



4.3 Characterization of the weak convergence 

In this section we use the fact that the trajectories or sequences are generated through a maximal monotone 
operator. 

Let us consider first the case A ^ I — T, where T is non expansive. The following result is in f5T, Pazy]: 
Proposition 30 The sequence T"a; converges weakly if, and only ifS^fb and Q[T^^x] C S. 

Proof. Assume S ^ %. Given u E S, the sequence ||r"a; — u\\ is decreasing and so T"^x is bounded. By 
Lemma [27l the fact that ri[T"x] C S implies that T"a; converges weakly. Conversely, since the sequence 
{r"a;} is bounded, the argument in the proof of Theorem [42l shows that the weak limit of T"a; must be in 
S. U 

An alternative proof relies on the following result, which is interest in its own right: 

Lemma 31 Assume the sequence UnX = \{z + Tz + ... + T'^-^z) IS hounded. Then 7^ n[Unx\ C S. 
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Proof. For any y £ H one has 

< \\T''x-yf -\\T''+^x-Tyf 

= IIT^T - Tyf - WT'^+'x - Tyf + \\Ty - yf + 2{T''x - Ty, Ty - y). 

By taking the average we obtain 

< -||x - Tyf + \\Ty ^ yf + 2{UnX - Ty, Ty - y). 
n 

Therefore, if p G f2[C/„x], we can let n — s- cx) to deduce that 

0<\\Ty-yf + 2{p~Ty,Ty-y). 
In particular, if y — p we conclude that \\Tp — p\\^ < and so p E S. I 

Assuming that S is nonempty we can give a direct proof: 
Lemma 32 Assume S Then T"x p implies p E S. 

Proof. For any y £ H and u £ S 

< \\T'^x-yf-\\T'+'x-Tyf 

= \\T^x - - ||r^-+ia; - u\\^ + \\u - y\\^ - \\u - Tyf 
+2{T''x -u,u-y)- 2{T^+^x -u,u-Ty). 

Take y = p and let k — > oo. Since lim WT'^x — p\\ exists we get 

k — >CXD 

< \\u-p\\^ + 2{p-u,u-p) - \\u-Tp\\^ -2{p-u,u-Tp). 
which is precisely \\Tp — < and implies p E S. ■ 

Following 52, Pazy], one obtains the continuous counterpart of Proposition [501 
Proposition 33 The trajectory Stx converges weakly if, and only if,S^$ and fl[Stx] C S. 

Proof. Assume S By Corollary [H] and Lemma E71 il[5fa;] C S implies Stx converges weakly. 
It remains to prove that if Stx y then y E S. To see this, take any [u, w\ E A. We have 

\\StX - uf - \\x - uf < 2 /" {w,u-Ssx)ds 

Jo 

= 2t{w, u — y) + 2 / {w, y — Sgx) ds. 
Jo 

It suffices to divide by t and let i ^ oo to obtain 

< {w, u — y) 

so that y E S hy maximality. ■ 

Note that the proof uses the generator A (compare to the proof of the previous Proposition [50)). 

A last result, due to [HI Bruck], shows that if 5 7^ 0, then weak convergence is equivalent to weak asymptotic 
regularity. We follow [531 Pazy]- 
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Proposition 34 Assume 5 7^ 0. The trajectory Stx converges weakly if, and only if, 

St+hX — StX ^0 as t ^ GO 
for each h>Q. A similar result holds for the sequence T"x. 

Proof. For u G S and t > s we have 

2{Ss+hX - u, SsX -u) ~ 2{St+hX - u, StX ~ u) < ||S's+/ia; - - \\St+hX - + ||w - SsxW^ ~ \\u - StxW^. 

Let w € Q,[Stx\ and hk — > 00 with St+h^ ~^ Then Ss+h^ ~^ w as weh by weak asymptotic regularity. 
Thus we obtain 

2{w — u, SsX — Stx) < \\u — — \\u ~ Stx\\'^. 

so that by (al), {w — u, Stx) has a limit L{w). In particular w' G VL[Stx] implies {w — u, w') = L{w) so that 
{w — u,w' — w) = 0. Hence by symmetry {w' — u,w — w') = 0, thus w — w' and r2[5'tx] is reduced to one 
point. ■ 



5 Weak convergence in average 

A trajectory u{t) converges in average if 

1 f* 

u{t) = — I u{C) converges as t ^ 00. 

^ ^0 

Similarly, consider a sequence in H along with stepsizes {A„}, then {a;„} converges in average if 

1 " 

Xn = Aft 



\kXk converges as n ^ 00. 

fe=l 



5.1 Continuous dynamics 



Consider x £ D{A). In order to use the semigroup notation, let us introduce 



1 /■* 

(7(2; = - / SsX dsH 
i Jq 



In order to prove that atx converges weakly as i — > 00 we follow the ideas in [121 Baillon and Brezis]. We 
first prove that the projection PgStX converges strongly to some v (a2), next that weak cluster points of 
atX are in S (b'), and finally use Lemma [^5] to conclude that atX converges weakly to v. 

Lemma 35 Assume 5 7^ 0. Then PgStX converges strongly. 

Proof. Let v(t) — PgStx and observe that the function ■0(t) = \\v{t) — Stx\\ is decreasing: 

+ h)< IHt) - St+hx\\ - WShvit) - ShStxW < iPit). 
Therefore, it has a limit as f — s- cx). On the other hand, the parallelogram equality gives 

\\v{t + h)- vit)f + 4 - St+kx ' = 2\\v{t + h)~ St+hx\\^ + 2\\vit) - St+hxf. 



^More generally a„x = SbX a„{s) ds where an is the density of a positive probability measure on R"^, which 
is assumed to be of bounded variation with f^ \dan\ — > 0. 
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S convex implies 



v(t+h)+v{t) o , ^ 



> ip{t + h). We finally get 
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2 

\\v{t + h)- v{t)f < 2 [iP{tf - il){t + h) 
and conclude that v{t) has a strong limit v a&t^oo. 



Lemma 36 ri[(Tta:;] C S. 

Proof. Assume crt^a; ^ u as fc — > oo and recall that u{t) — Stx. For any v e D{A) we have 

Now take w £ Av, so that {u{t) — v, —w) > {u{t) — v, u{t)). This gives 

2 / {w^v- Stx) dt> \\St^x ~ vW^ - Wx-vW^ > -||a;-u||^ 







Divide by tk and take the weak limit as fc ^ oo. We get {w,v — u) > for any [v,w] G A, so G Au by 
maximality. H 

Comments 



Lemma [551 implies that if 5 = then \\<Ttx\\ oo for every x G D{A) as t ^ oo. On the other hand, if 5 7^ 
then every trajectory StX is bounded, so atx is bounded for all x G D(A). □ 

Using Lemma \28\ Lemma [35] and Lemma [36l wc finally obtain 
Theorem 37 If S ^ $, then atX converges weakly to v — lim P^StX. 

As a consequence of Proposition [29] one has 

Proposition 38 If S ^ 0, the limit w — lim otx is the asymptotic center AC{Stx}. 
Comments 

Weak convergence in average is still true in uniformly convex Banach space with Frechet-differentiable norm 
(see [5S1 Reich]) or satisfying Opial's condition (see [331 Hirano]). □ 

li A = df with / G ro(i?), convergence in average guarantees the convergence of the trajectory (see [HI 
Bruck] ) : 



Proposition 39 If A = df then lim 



t — >oo 



= 0. 



Proof. Integration by parts gives u{t) — j u{s) ds — j /J su{s) ds. \\u{t)\\ being decreasing by Proposition 
HI one has 

s\\u{s)f ds > \\u{t)f f sds = lt^\\u{t))f. 

t/2 Jt/2 8 

But in the case A = 9/, the function 1 1-^ t||-it(i)|p is in L^(0, 00) (see [HI Brezis] ) which implies lim t||u(t)|| = 

t — >oo 

and the result follows. ■ 



It is known that both the trajectory and the average converge weakly (Theorems [37l and [47)) . The preceding 
result implies, in particular, that the average cannot converge strongly unless the trajectory itself does. 
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5.2 Proximal sequences 

Consider a proximal sequence {xn} in H along with stepsizes {A„}, and recall that a;„ = ^ ^k^k- 
The next result was presented in [ID, Lions]: 

Theorem 40 Let 5 7^ 0. Then converges weakly in average to a point in S. 



Proof. The case {A„} ^ l'^ will follow from Theorem [48l which states that {x„} converges weakly under 
this condition. Therefore we assume {A„} S £^ and check the conditions of Lemma [27l with F = S: (al) 
follows from Corollary [T51 while (b') follows from Lemma HTl below. ■ 



Lemma 41 Assume {A„} G i"^, then n[x„] C 5. 
Take [u, v] ^ A and use ([3]) so that 

||w - a;„+l||^ < ||u - Xn + \nV\\^ = \\u - a;„||^ + A^||u||^ - 2{v, XnXn - Ku). 

Summing up for k — 1, 2, ... n and dividing by cr„ we obtain 



1 



2{v,Xn -U) < —\\xo - m|P + —\\vf 

If Xn ^ X, then {v,u ^x) > 0, hence a; G 5 by maximality. 
This is the counterpart of Lemma [36l 

The extension to the sum of two operators is in [151 Passty]. 



5.3 Euler sequences 

For nonexpansive mappings, weak convergence in average of the discrete iterates was established in [3 
Baillon]. The proof is again of the form (a2) and (b') but note that the property 5 7^ is not assumed but 
obtained during the proof. 

Theorem 42 Let T be a nonexpansive mapping on a bounded closed convex subset C of H . For every z € C 
the sequence z„ = T"z converges weakly in average to a fixed point of T, which is the strong limit of the 
sequence PsT^z. 



Proof. Note that for any a and a% i = 0, n — 1, in iJ, the quantity 

2 

^ IL — J. 

a 



ill 2 



Ea' - - lla - a 

1=0 1=0 

is independent of a. Hence with UnZ = j^{z + Tz + ... + T'"-~^z) one has 

-. n — 1 -.n — 1 

\\TUnZ - Unz\\^ = - y \\TUnZ - T zf - - V ||C/„z - z\\^ 



<-[\\TUnZ-zr-\\UnZ-r'-^zf^ 
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so that 



\\TUnZ-UnZ\\ < —\\TUnZ-z\' 



Thus TUnZ — UnZ — > and if UnZ u then Tu = u by Proposition [3l It follows that ri[J7„z] C 5, which is 
(b') and 5^0. Since, for u G S, ||T"z — u|| decreases, then letting VnZ — P^T^^z, |jT"z — Vnz\\ decreases 
as well, hence VnZ converges to some V (like in the proof of Lemma [35l) which implies that = {V} 

by Lemma [28l ■ 



Comments 

The conclusion of Theorem [42] holds also if X is uniformly convex with Frechet-differentiable norm and 
A„ ^ 1 or if X is superreflexive ( 55, Reich]). □ 

By following an idea of Konishi (see [TTl Baillon]) one can prove that the ergodic theorem for non expensive 
mappings implies in fact the analogous results for the semi-group: 



Proposition 43 Theorem implies Theorem \3j_ 



Proof. Let < h < t and n = [t/h] the integer part of t/h and set Th = Sh and UnX = ^ J2m=o T™'x. One 
has 

tcjtx — I Ssxds + ...+ I Sgxds + / Ssxds 

Jo J{n-l)h Jnh 

and 







/ Sgxds — hx 




Jo 





Similarly 



hence 



(m+l)h 
rnh 



Ssxds ~ HTJ^x 



■(m+l)/i ph 
< I \\SsX - Srnhx\\ds < / \\SsX-x\\ds 

rnh Jo 



where < M. Thus 



\\tatx — nhUnx\\ < n / \\SsX — x\\ds + Mh, 
Jo 



1 f 2M 

\\o-tx-Unx\\<- \\SsX-x\\ds-\ . 

h Jo n 



But as i — > +00, UnX converges weakly to a fixed point Uh of Th by Theorem 1421 

Let us now prove that Uh is a Cauchy net as ft- ^ 0. Given < h, h' < t, n — [t/h], n' — [t/h'] one has 



U„x — Uri'xW < — I \\S^x~x\\ds 



2M 1 
n h' Jq 



h' 



5,x — x\\ds 



2M 



Hence as t ^ +00 



1 1 [''' 

\uh-Uh'[\<- [\SsX ~ x[\ds + — I [\SsX~x[[ds, 



lo " ^0 

thus Uh is a Cauchy net that converges to some u, since [\SsX — — > as s —>■ 0. But SmhUh = Uh, so that 
given s and h ~ s/m one has SsUh = Uh- As to — )■ +00 this implies SsU = u, thus u Cz S. Now write, given 
yeH 

[{atx - u,y)[ < [{atx - UnX,y)[ + [{UnX - Uh,y)[ + [\uh - u[\[\y[\ 
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hence 

(1 2m\ 
- J \\SsX - x\\ds + — j \\y\\ + \{UnX - Uh,y)\ + \\uh - u\\\\y\\ 

It follows that 

\\SsX ~ x\\ds \\y\\ + \\uh - u\\\\y\\ 



limsupKcTta;- < ( t / 



for all h > 0. Letting — > we obtain atx u. 



Set Zn = — X]fc=i ^kZk: where z„ is given in (|13p . A general result on convergence in average is the following 
from 121 Bruck]: 

Theorem 44 Assume '^\\zn — z„_i||^ < oo. If S ^ %, then Zn converges weakly in average to w = 
lim PsZn- Otherwise lim ||z„|| = oo. 



Proof. We first prove that VL[zr^ C S which is (b'). Then we show, if S is non empty, that the sequence 
of projections C„ = PsZn converge strongly to some C, € S which is (a2) and finally that C, is the only weak 
cluster point of the bounded sequence {z„}. 

First, let [u, v] ^ A and set Wn — {zn — Zri+i)/A„ G Az„. We have 

||z„+l-ti|P = \\Zn - XnWn - u\\^ 

= ||z„ - + ||A„it;„|p + 2A„(w„,u - z„) (24) 
< \\zn - m|P + ||A„w„|p + 2A„(u, u- Z„). 

Summing up, neglecting the positive term of the telescopic sum on the left-hand side and dividing by a„ we 
get 

II 112 1 " 

Zl — U\\ 1 v-^ ,, ,i9 „ , X 

an 

Therefore liminf„^oo(''^) "i* ~ ^n) ^ and every weak cluster point of {zn} lies in S, by maximality. 
Note that this is (b'), hence the counterpart of Lemma [551 and Lemma BT] 

Next, take u ^ S. From equation ((24|) we get 

\\Zn+l - U|P < \\Zn - U|P + WKWnf- (25) 

This implies the convergence of ||zn+i ^ u|p hence (al) which ends the proof by using Lemma [27l 
So the use of the following alternative is to identify the limit. This proof of (a2) parallels Lemma 155] 
Using the parallelogram identity and the convexity of S we obtain 

llCn+l ~ CniP — 2||z„_|_i — C„|p + 2||z„+i — Cn+l|P ~ 4||z„_|_i — ^{(n + Cn+l)|P 
< 2||z„-|_i — C„|p — 2||z„+i — Cn+l|P- 

Inequality (|25p with u = Cn gives 

< ||C«+1 - C"ll^ < 2\\XnWnf + 2\\Zn - Cn f - 2||z„+i - Cn+l||^ 

This implies that the sequence {||z„ — Cn|P + Pn} decreases, where p„ — J2k>n ll'^fe^felP? which tends to 
as n — > oo. Since 

1^ llCn+p ~ Cnll 1^ '^Pn + 2||2:„ ~ Cnll ~ 2||z„_|_p — Cri+p|l j 
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the sequence {Cn} is Cauchy and converges as well to some ( in S. The results now follows from Lemma B51 
■ 

Observe that the same structure of proof could be applied to proximal sequences. 

For a similar proof with two operators and forward-backward procedure see |48l Passty] . 

The following result due to [53. Pazy] of (b') leads to a unified proof of weak convergence in average for 
contractions in the discrete (Theorem |42|) or continuous case (Theorem [37|) . Note that the first step assumes 
S ^% and then one uses (al) to achieve the result. 

Proposition 45 Assume 5 7^ 0, then Q,[atx\ C S. 

Proof. For t, h > we have 

< \\Stx - yW^ - \\St+hX - ShuW^ 

= \\SfX - Shy\\^ - \\St+hX - S/ij/lp + 2{Stx - Shy, Sny - y) + \\Shy - y\\^. 

By taking the average we deduce that 

1 /■* 

< - / [\\SsX - Shy\\^ - \\Ss+hX - Shy\f]ds + 2{atx - Shy,Shy - y) + \\Shy - y\f. 
^ Jo 

Since 5 7^ 0, 115*43; — Shy\\ is bounded, hence letting t +00, it follows that for any p £ r2[(Tta:], any h > 
and any y G H 

0<2{p~Shy,Shy^y) + \\Shy~y\\^. 
Finally take y — p so that p — ShP, which means p Cz S. I 



6 Weak convergence 

Not all maximal monotone operators generate weakly convergent trajectories. 

Example 3 Let R : be the counterclockwise 7r/2— rotation and consider the evolution scheme 

defined by the differential equation: 

u{t) = R{u{t)). 

Note that S — {0}. The orbit starting at time t = from the point uq — ro(cos(6'o), sin(6'o)), r > is 
described by u{t) — ro(cos(t — 6'o),sin(t — do)), which is bounded but does not have a limit as t ^ 00. 
However, the average j u(s) ds converges to as i —> 00, by Theorem 1371 



Now let Xn — Tnicos 9n, sinOn) satisfy 

Xn+l X'n 



R{Xn+l). 



We have r^^^ = Ofe^iCl + ^^^^''o and 9n — Oq + a'rctan(A/c). The sequence r„ is decreasing. If 

Xn ^ then lim x„ = 0; otherwise it stays bounded away from zero. On the other hand, the argument 9n 

n — >oo 

is increasing. It converges if A„ € £^ and diverges otherwise. Observe also that Xn converges in average to 
as n — > 00, by Theorem 1401 
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Finally, let z„ — p„(cos </>„, sin </>„) satisfy 



An 



i?(z„). 



Here p^+i = nfc=i(l + ^k)Po a-nd = (^o + Sfc=i arctan(Afe). In this case the sequence r„ is increasing. 
It remains bounded and is convergent if, and only if, A„ G The argument 0„ is increasing as well. It 
converges if A„ G and diverges otherwise. As before, z„ converges in average to as n — > oo, by Theorem 
HI. □ 



Tools 

Assuming S non empty and using Lemma I27[ by virtue of Corollaries [51 [T2] and 1191 in order to prove weak 
convergence of u{t), it suffices to verify that its set of weak cluster points lie in S (condition (b)). The key 
tool is the concept of demipositivity, first developed in 22, Bruck]. 

A maximal monotone operator A is demipositive if there exists w G S such that for every sequence G 
D{A) converging weakly to u and every bounded sequence {vn} such that w„ G Aun 

{vn, Un — w) implies u G 5. (26) 

Proposition 46 Each of the following conditions is sufficient for a maximal monotone operator A to be 
demipositive: 

1. A — dcf), where (p is a proper lower- semicontinuous convex function having minimizers (S ^0). 

2. A — I ~ T , where T is nonexpansive and has a fixed point (S ^ 

3. The set S has nonempty interior. 

4-. A is odd and firmly positive, which means that there is w G S such that v G An and {v,u — w) = 
together imply G Ax. 

5. A is firmly positive and sequentially weakly closed (its graph is sequentially weak/weak closed). 

6. S and A is 3-monotone, which means that X]n=i(y"''^n ~ Xn-i) > for every set {[xn,yn] \ 1 < 
n < 3} C A (xq = xpf ). 

For demipositivity in Banach spaces see p6l Bruck and Reich]. 

Comments 

We just mention another assumption that guarantees that the weak cluster points will lie in S: Let S the 
semi-group generated by A. A satisfies condition (L) if 

lim ||yl"S'ta:|| < lim {\\\St+hX - Stx\ 
t — >oc t — >oo \ ri 

for every /i > and x G D{A). An equivalent formulation is the following: Denote by a° the element of 
minimal norm in R[A). Then A satisfies condition (i) if, and only if, for every x G D{A) one has 

lim A°StX = a°. 

t — >oo 

Unlike demipositivity, this does not impose a priori that 5 7^ 0. For instance, ii A — df with / G ro(-ff) or 
if j4 = / — T with T nonexpansive, then A satisfies condition (L) but is not demipositive unless 5 7^ 0. 
Condition (L) is essentially used in FSUl Pazy] to prove that the weak cluster points of the trajectory Stx lie 
in S. If iS = one immediately deduces that lim ||S'ta;|| = 00. The interested reader may find this definition 

t — >C30 

and related results in [SHI Pazy]. □ 
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6.1 Continuous dynamics 

The following classical result of weak convergence for demipositive operators was proved in |22[ Bruck] . 
Theorem 47 If A is demipositive then u(t) converges weakly as t ^ oo to an element of S. 

Proof. By Corollary [6] and Opial's Lemma it suffices to prove ri[u(i)] C S, which is (b). Let w E S satisfy 
and let u(t„) u as n oo. The sequence is bounded by Theorem [TUl Let 0^{t) = — 

thus 9^{t) = {u{tn), u{tn) — w). Sincc 9^ is bounded by Corollary[6l 0^, G and there is a subsequence 
of tn such that 0io{tnk) — > as fc ^ oo. But u{t„^) ^ u, so u € 5 by demipositivity. ■ 

Comments 

Theorem l47l was extended in [49l Passty] to the class of (p- demipositive operators. □ 



6.2 Proximal sequences 

A first detailed study of the asymptotic behavior of the proximal sequence was performed in [571 Rock- 
afellar], when the stepsizes are bounded away from zero. The author also considers an inexact version of the 
algorithm. The next convergence results under more general hypotheses are investigated in [201 Brezis and 
Lions] . 

Recall that cr„ = Em<n and r„ = Em<n ^m- 

Theorem 48 Assume S ^ If {A„} ^ £^ then Xn converges weakly to some x* £ S. Moreover, ||y„|| < 
d{xo,S)Tn 

Proof. By Lemmas [Tl] and [121 '^^ have for any x G S 

Tn OO implies ||yn|| 0. Since — ?/„ e Axn, we deduce that f2[a;n] C S, which is (b), by Proposition [3] 
We conclude by Corollary [T3| and Opial's Lemma ■ 

The following result, adding the demipositivity hypothesis, is also from [201 Brezis and Lions]: 
Theorem 49 If A is demipositive then x„ converges weakly to some x* G S. 



Proof. As above, using Corollary [T3| the result follows from Opial's Lemma [^ if Vl[xn] C S which is (b). 
Let Xrik X and w be the element in S used in the definition of demipositivity (|26p . Using Lemma 1501 
below we construct another subsequence {xm^} such that both Wxm^ — Xn^W and {xm^ — w,ymk) tend to 
as fc ^ oo. Since Xm^ ~^ x and A is demipositive, x must belong to S. H 



Lemma 50 Let {x„} he a proximal sequence and w Cz S. For each e > 0, there is N such that: for any 
n > N, there exists to G N satisfying N < m < n, \\xm ~ a^nJI < £ md {—ymiXm ~ w) < e. 
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Proof. For each w £ S we have — w\\^ > ||a;A_, — w|p + 2Xk{—yk,Xk — w) and so 

^ Xk{yk,w - Xk) < oo (27) 
k 

where all terms are nonnegative by monotonicity. Given e > 0, define P = {fc € N | {yk,w — Xk) > s} so 
that J2k(^p^k < oo. Since ||xfc_i - Xk\\ = XkWvkW, Lemma E] implies J2k(^p\\^k-i - Xk\\ < oo. 
Let A^i so that "^k^P k>Ni ll^fc-i ~ < e. By virtue of (P7)) . since {A„} ^ there is > iVi with 
{Un^w — xn) < e. Consider n > N: if n ^ P we choose m = n. li n £ P, let m ~ max{fc < n \ k ^ P}. 
Since m > A^i and all integers between m and n are in P, we have — Xn\\ < X]m<fe<n ll^fe-i ^ < e. 



Comments 

1. Theorem HHl is still true if the sequence satisfies ||a;„ — (/ + A„A)~^x„_i|| < e„ with J2^n < oo. This 
is proved in [20i Brezis and Lions] and can also be derived using asymptotic equivalence results in 
Section [8](see [2l[3]). 

2. In uniformly convex Banach spaces with Frechet differentiable norm there is weak convergence in the 
following cases (see [56l Reich]): 

(a) {A„} does not converge to zero, or 

(b) The modulus of convexity of the space satisfies S{e) > Ke^ for some K > and p > 2 and 

3. Demipositive can be replaced by i^-demipositive (see ^49, Passty]). □ 



6.3 Euler sequences 

Let {z„} he an Euler sequence and recall that w„ = ^"+^~^^ g — ylz„. 

Theorem 51 Let A be demipositive and assume {A„} G i'^ and {w„} bounded. Then z„ converges weakly 
to some z £ S . 

Proof, li y £ S, Corollary [19] shows that the sequence \\zn — y\\ is convergent. On the other hand, equality 
(fT5)l implies X)ri>i ^n{wn,y — Zn) < oo. One concludes as in Theorem l49l using an analogue of Lemma [50lB 

Comments 

The previous result from [26l Bruck and Reich] works for demipositive operators in "a few" Banach spaces, 
namely X = L^™, m € N or X = ^p, p e (1, oo). □ 

A related result from |561 Reich] is the following (and holds in uniformly convex Banach spaces with Frechet- 
differentiable norm): 

Proposition 52 Let T be non-expansive, A — / — T and {A„} satisfying < A„ < 1 and ^ A„(l — A„) = oo. 
If S ^ then {zn} converges weakly to a point in S. 

If yl = df with / £ Tq{H) and dim(_ff) < oo one can circumvent the difficulties of Lemma [501 and provide a 
simpler proof of Theorem 1511 Let 

Zn+l £ Zyi - A„a/(z„) 

and Wn as above. 
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Theorem 53 Assume 5 7^ and dim(H) < 00. If^ \\zn ~ z„_i|p < 00 then Zn converges to a minimizer 
off. 

Proof. Lemma [24] gives liminf /(z„) — /*. Since {z„} is bounded and the space is finite dimensional, there 

n — >oo 

is a subsequence {zn^} such that hm /(z„^) = /* and Km ||z„j, — 2|| = for some z Cz H. Since z must be 

k — >oo k — >oc 

in S by lower-semicontinuity, Corollary [19] implies lim ||z„ — 2;|| = 0, which means z„ converges to 2;. ■ 

n — *C30 

The preceding result from [58] was pointed out to the authors by R. Cominetti. 

7 Strong convergence 

Even if A = d4> with (p € Tq{H) having minimizers, the trajectory u{t) need not converge strongly as t — > 00. 
This is shown by Baillon's example in [lOl Baillon]: the author defines a function (j) G ^o{£'^) having mini- 
mizers and proves that the trajectories converge weakly but not strongly. 

This also true for the proximal point algorithm. Even if A = dcj) with (jj S ro(-ff) having minimizers, a 
sequence satisfying ([7]) need not converge strongly. This was proved in |311 Giiler] using Baillon's example 
and the equivalence techniques from [551 Passty]. A simpler example of this type can be found in [T3] and 
can be retranslated to provide a new counterexample for strong convergence of the continuous trajectory, 
different from that of Baillon. 



Conditions 

We introduce here a series of conditions, mainly of geometric nature, that will be used to obtain strong 
convergence of the process in the continuous or discrete set-up. 

Strong monotonicity. Let a > 0. An operator A is a-strongly monotone if for all [a;, a;*], [y,y*] £ A one 
has 

{x* -y*,x-y) > a\\x - y\\^. 

Observe that if A is strongly monotone and Ax n Ay 7^ 0, then x ^ y. If A is a-strongly monotone then 
Jy^ is a strict contraction. Therefore it has a fixed point p and only one, say S — {p}. Strongly monotone 
operators are demipositive. 

Clearly, if A is monotone, then A -f al is a-strongly monotone. Also, subdifferentials of proper, lower- 
semicontinuous strongly convex functions are strongly monotone. 

A weaker notion of strong monotonicity found for instance in '50, Pazy] is the following: A is a-strongly 
monotone if 5 7^ and 

{A°x,x~Psx) > a\\x- Pgxf 

for every x G D{A). In this case the set S need not be a singleton. Proposition [54l below also holds if A is 
strongly monotone in this sense but the proof is more involved. 

Solution set S v^rith nonempty interior. If p e int5 then there is r > such that the ball B{p, r) of 
radius r centered at p is contained in S. Then {u*,u — p + rh) > for all G A and all h £ H with 

\\h\\ < 1. Therefore {u*,u — p) > r(u*,-h) and 

r||u*|| =r sup {u*,-h) < {u*,u-p). (28) 
\\h\\<i 

The NR convergence condition. A maximal monotone operator A on H satisfies the NR convergence 
condition if 5 7^ and for every bounded sequence [xn , j/n] G A one has 

liminf (y„, a;„ — PsXn) = implies liminf \\xn — PsXn\\ = 0. 
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Strongly monotone operators satisfy this condition. So do operators having compact resolvent (see below) 
and those satisfying (y, x — Psx) > for all [x, y] E A such that x ^ S. 

The NR convergence condition can be easily stated in a Banach space X by means of the duality mapping. 
The results below hold when both X and X* are uniformly convex. The interested reader can consult [46l 
Nevanlinna and Reich] and [26, Bruck and Reich] . 



Compactness. The strong w-limit set of a trajectory u : [0,oo) — > _ff is the set LLj[u{t)] — f] {u{s) : s >t}. 

t>o 

For a sequence {xn} it is defined by w[a:;„] = f] {xk : k > n}. 

By virtue Lemma [27l the sets w[u(i)] n S and Ci;[2:,i] n S contain, at most, one element. 

If 5 7^ and is a compact operator (maps bounded sets to relatively compact sets) then Li;[M(t)] ^ for 
every trajectory u satisfying ([5]) (see Theorem 11.8 in [501 Pazy]) and uj[xn] ^ for every sequence {x„} 
satisfying ([7]). 

For instance, if A = df and the set { u £ H \(p{u) + < M } is compact for each M > 0, then jf is 
compact. This case was first studied in [19} Brezis]. 

Symmetry. An operator A is odd if D{A) = ~D{A) and A{-x) = ~Ax for aU x e D{A)^ This is the 
case, for instance, ii A = df and / is even. If A is odd, the semigroup generated is odd as well (see, for 
instance, [50l Pazy]). On the other hand, it is easy to see that is odd for each A > if A is odd. 

Notice also that if A is odd then S Moreover, G 5. To see this, take x £ D{A) and let [x, y], [—x, —y] S 
A. We have 

A{y — 0,x~0) = (y + y,x + x) 

= {y - i-y),x - {-x)) 
> 0. 

Then e v40 by Lemma [H 

Asymptotic regularity. A trajectory u is asymptotically regular if lim \\u{t + h) — u{t)\\ — for each 

t — ^CJO 

h > 0. A sequence is asymptotically regular if lim ||a;„+m ~ a;„|| — for each to e N. 

n — >oo 

Comments 

Recall that the notion of weak asymptotic regularity was mentioned in Proposition 1341 as a characterization 
of weak convergence of the trajectories satisfying ([5]). □ 



7.1 Continuous dynamics 
Strong monotonicity. 

Proposition 54 // A is a-strongly monotone for some a > then u(t) converges strongly to the unique 
p £ S as <—> oo. 

Proof. Strong monotonicity implies 

^A weaker notion is that ^°(— a;) — —A'^x. The results below still hold but the proofs become more technical. 
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and so \\u{t) - p\\ < e^'^°''^\\uo - p\\. 



Comments 

The previous result can be extended in the following way: Let X be a Banach space such that X and X* 
are uniformly convex. In [461 Nevanlinna and Reich] the authors prove that if A satisfies NR convergence 
condition then u{t) converges strongly to a point in 5 as i oo. If only X* is uniformly convex, the result 
remains true provided Ax is proximinal and convex for every x (see |26{ Bruck and Reich]). If neither X 
nor X* is uniformly convex, the result is still true if the semigroup is differentiable (see |46| Nevanlinna and 
Reichl). □ 



Solution set with nonempty interior. 

Proposition 55 Assume int 5^0. Then u{t) converges strongly as t ^ oo to a point in S. 

Proof. If B{p,r) C S, inequality (pS]) implies 

r\\u{t) - u{s)\\ < r [ \\u{t)\\ dr 



J s 

= \Ms)-pf~\\Ht)~pr. 

Since \\u{t) — p\\ is convergent by Corollary[Sl u{t) has the Cauchy property. 



Comments 

Theorem 4 in [46' Nevanlinna and Reich] shows that this result remains true if X and X* are uniformly 
convex. In the same paper, the authors give a counterexample in C([0, 1]; R). See also 26, Bruck and Reich]. 
□ 



Compactness. 

Proposition 56 If ijj[u{t)] n 5 7^ then u{t) converges strongly to some p G S. 



Proof. If p e a'[M(t)] n S then \\u{t) — p|| is decreasing and liminf \\u{t) —p\\ =0. Hence u{t) ^ p as t — > 00. 

t — ^00 



Comments 

If S has nonempty interior then A is demipositive and a;[M(t)] 7^ for every trajectory u satisfying ([5]). Every 
strong cluster point is also a weak cluster point, that must lie in S by dcmipositivity. Hence a;[it(i)] H 5 7^ 
and Proposition [55] can also be deduced from Proposition [551 □ 



Symmetry. 

Proposition 57 If A~ df and f G ro(i?) is even then u{t) converges strongly as t 00 to a point in S. 
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Proof. Take s > and define 7(t) = \\u{t)f - \\u{s)\\^ - i||it(t) - u{s)f. For t e [0, s] one has 

jit) = {u{t),uit) + uis)) < fi~u{s)) ~ f{u{t)) = J{u{s)) - f{u{t)) < 0. 
Therefore, -fit) > j{s) ~ and so 

l\\uit)-u{s)r<\\uit)r-\\u{s)r. 

Since G Argmin /, 11^(^)11 converges as i ^ oo so u{t) has the Cauchy property. ■ 
For general A one has to assume additional hypotheses on the trajectory: 

Proposition 58 Let A be odd. If u is asymptotically regular then u(t) converges strongly to some p Cz S as 
t oo. 

Proof. Let us use the semigroup notation u{t) ~ Stx. If A is odd then G S and 

\\St+h+sX + St+sX\\ = \\St+h+sX ~ St+s{~x)\\ 

< \\St+hX ~ St{-x)\\ 
= \\St+hX + Stx\\ 

for each /i > so that 

lim \\Stx + St+hx\\ < \\Stx + St+hx\\. (29) 

t — >oo 

Since e 5 the limit d — lim \\Stx\\ exists. Moreover, the fact that ||25ta;|| < \\StX + St+hx\\ + \\StX — St+hx\\ 

t — >oc 

implies 

2d < lim \\Stx + St+hx\\ < \\Stx + St+hx\\ 

t — >oc 

for each t,h hy asymptotic regularity and inequality (|29p . Finally, 

\\St+hX~Stxf = 2\\Stxf + 2\\St+hxf -\\St+sX + Stxf 
< 4||S't.T||2 -4^2 

and so {Stx} has the Cauchy property. ■ 



Comments 

Without the asymptotic regularity assumption, strong convergence holds for the averages when S is odd, as 
proved in (see [8| Baillon]). □ 



7.2 Proximal sequences 
Strong monotonicity. 

Proposition 59 If A is a-strongly monotone for some a > then x„ converges strongly to the unique p €z S 
as n oo. 
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Proof. Strong monotonicity implies 

aA„||a;„-p|p < (x„„i - a;„, a;„ - p) 

< \\Xn -p\\ {\\Xn-l -p\\ - \\Xn - p\\) 

SO that 

oc 

51 -^"11^" ~ P\\ - 11^0 - p\\ < oo. 

n=l 

Since the sequence ||x„ — p|| is decreasing this impUes hm ||a;„ — p|| — 0. 

n — >oo 

Solution set with nonempty interior. 

Proposition 60 Let A be maximal monotone with int 5 7^ 0. Then Xn converges strongly as n 00. 

Proof. If B{p,r) C S inequality [28l gives r||a;fc_i — Xk\\ < (xk-i — Xk,Xk ~ p) and so 

r\\xk^i~Xk\\ < {xk-i - p,Xk - p) - \\xk - pW^ 

by Corollary [131 Hence 

m 

r\\x„-Xm\\ < r ^ \\xk-i-Xk\\ 

k=n+l 

< \\X0 - P\\ {\\x„ - p\\ - \\Xm - P\\^ ■ 

Since ||a;„ — p\\ is convergent, Xn is a Cauchy sequence. 
The NR convergence condition. 

A fairly general result is the following, from f46l Nevanlinna and Reich] : 

Theorem 61 If A satisfies the NR convergence condition then x„ converges strongly as n —> 00. 
Proof. Setting j„ = a:„ — PsXn we have 

WinW^ + K{yn,3n) = {x^^i - PsX^, jn) 



(jn-l,jn) + {PsXn-1 " PsXn,Xn ~ PsXn) 



< 



\\Jn-l\\ \\jn 



< ^[l|jn-l|P + lb«f]- 

Thus ||j„|P + 2A„(y„,j„) < and J2'^=i ^niVn, jn) < 00. Since {y„J„) > one must have 

liminf„^oo(y„, j„) — 0. The sequences {xn} and {j/n} are bounded, and the convergence condition im- 
plies liminf„^oo ||x„ — P5a;„|| = 0. Since \\xn — PsXnW is nonincreasing, it must converge to 0. On the other 
hand, the sequence |ja;„ — p\\ is nonincreasing for each p G S. In particular, ||a;„+„j — PgXnW < ||a;„ — Psx^W 
and therefore ||.x„+„j — Xn\\ < 2||x„ — P5a;„||. We conclude that Xn converges strongly to some p £ 5 as 
n — > 00. H 



Compactness. 
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Proposition 62 If Lu[xn\ (1 S =/= $ then Xn converges strongly to some p G S. 

Proof. If p e U![xn] n S then — p\\ is decreasing and liminf \\xn — p\\ =0. ■ 

n — >oo 

Symmetry. 

For even functions we have the foUowing resuh from (20| Brezis and Lions] : 

Proposition 63 If A is the subdifferential of an even function in f G Tq{H) then Xn converges strongly as 
n — > oo. 

Proof. Recall that 2A„(/(u) — f{xn)) > \\u — — \\u — a;„_i|p. Let m > n and take u = ~Xm- 
Since n i-^ f{xn) is decreasing we have ||a;„i + a^nll < \\xrn + a^n-iH and the function n ^ \\xrn + a^nll is 
decreasing. In particular Hxm + a^mll < ||a;m + a;n||, thus 4||a;„i|p < ||a;m + a;„|p. We have 2||x„||^ + 2||a;„j|p = 
\\xra + a;„|p + ||x,„ - x„p > 4||xmp + \\xr,t - a;„|p, so that ||x,„ - a;„p < 2||x„|l^ - 2|la;„|p. Since ||a:„|| 
converges as n — > oo this proves that Xn is a Cauchy sequence. H 

As before, asymptotic regularity is required for a general A: 

Proposition 64 Let A he odd. If {xn\ is asymptotically regular then x„ converges strongly to some p G S 
as n oo. 

Proof. First, one easily verifies that G S and that the sequence ||x„+fe + a;„|| is decreasing for each fc S N. 
Finally one concludes as in the proof of Proposition [58l ■ 

Comments 

Without asymptotic regularity on can still prove strong convergence of the averages (see [40l Lions]) for odd 
operators. This was first proved in [£1 Baillon] in the case A„ = A. □ 



7.3 Euler sequences 
Strong monotonicity. 

Proposition 65 Let A be a-strongly monotone. If^ \\zn — z„_i|]^ < oo then z„ converges strongly to the 
unique p € S as n oo. 

Proof. Strong monotonicity implies 

2aA„||z„-p||2 + ||z„+i-pf < \\z„-pf + Xl\\wn\\^. 

Therefore 

oo 

2aj2>^n\\zn-pr<\\zo-pf+Y.xi\\wnr<^. 

n=l 

This implies liminf ||a;„ — p|| =0. But \\xn — p\\ converges by Corollarv ll9l I 
Solution set with nonempty interior. 
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Proposition 66 Assume int 5 7^ 0. //X) ll-^n ^ ^n-i|P < 00 then Zn converges strongly as n — > 00. 

Proof. If B[p,r) C S inequalities ([28]) and (fTS]) together give 

2rA„|jw„|| + \\zn+i -_p|p < \\zn - pIP + A^J|w„|p. 
Tliis implies the sequence A„||i/7„|| = H^n+i ~ Zn\\ is in £^ and so z„ converges. I 

The NR convergence condition. 

Theorem 67 Assume ^ ||z„+i — 2„|p < 00 andwn is bounded. If A satisfies the NR convergence condition 
then {zn} converges strongly as n ^ 00. 

Proof. To simplify notation write j„ — z„ — PsZn- We have 

||jn+l|P < \\Zn+l - PsZnW^ = \\j71 + A„W„|P = ||j„|P - 2A„(-W„, j„) + A^J|w„|p. 

By hypothesis and CoroUarv \W\ the sequence [z„,— w„] is bounded. Moreover, 

00 

A„(-w„, j„) < 00. 

n=l 

But {—Wmjn) > and so liminf(u;„, j„) = and the convergence condition implies liminf ||j„|| = 0. This 

n — >oo n — >oo 

sequence being convergent we have lim j„ = 0. Finally, ||2:„_|-„i — z„|| < 2||j„|| and so z„ converges as 

n — yoo 

n — > oo. I 



Comments 

The previous result holds if X and X* are uniformly convex (see [ISl Nevanlinna and Reich]). 

According to [261 Bruck and Reich], the convergence condition can be replaced by int 5 ^ 0. In that case, 
if X is not uniformly convex it suffices that Ax be proximinal and convex for each x. On the other hand, 
according to [46l Nevanlinna and Reich], the conclusion of Theorem |67] is still true, even if X and X* are 
not uniformly convex, provided S is proximinal and A is accretive in the sense of Browder. □ 



Compactness. 

Proposition 68 Assume that ^ H^n+i — ^nlP < oo and uj[zn] C\S Then Zn converges strongly to some 

pes. 

Proof. The argument is the same as in Proposition [56] by virtue of Corollary [TH ■ 
Symmetry. 

The following results uses the same ideas as in Propositions [58] and [64] but is apparently new: 

Proposition 69 Let T be non-expansive, A = I — T and A„ = 1 so that z„ = T"'zq. If T is odd and 
J2 li-^n+i ~ ZnW^ < oo then {zn} is strongly convergent. 
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Proof. Since T is odd one easily deduces that the sequence ||2;„+fe + Zn\\ is decreasing for each k. From 
the fact that ^||z„+i — z„|p < oo we can draw two conclusions: In the first place, Corollary 1191 implies 
d — lim \\zn\\ exists because S 5. On the other hand, the sequence Zn is asymptotically regular, so 

n — *cxD 

lim ||z„ — z„+fc|| exists for each k. As a consequence, 2d < \\zn+k + Zn\\ for each n and k. One concludes as 

n — >oo 

in the proof of Proposition [551 ^ 



Comments 

Without any further assumptions, T"z converges strongly in average if T (see [HI Baillon]). □ 



8 Asymptotic equivalence 

In this section we explain how to deduce qualitative information on the asymptotic behavior of the systems 
defined by ([51) , Q and (|13p . We provide a comparison tool that guarantees that two evolution systems share 
certain asymptotic properties. For the complete abstract theory see [Sj Alvarez and Peypouquet]. 



8.1 Evolution systems 

Let C be a convex subset of a Banach space X and let / denote the identity operator in X. An evolution 
system (ES) on C is a family {V{t^ s) : t > s > } of maps from C into itself satisfying: 

i) V{t, t) = I; and 

ii) V{t,s)V{s,r) = V{t,r). 

Let L > 0. An evolution system is L-Lipschitz if it satisfies 

iii) \\V{t,s)x~V{t,s)y\\ <i||x-y|| 
and is contracting (CES) if it is 1-Lipschitz. 

Example 4 Let be a (possibly multivalued) function from \tQ,oo) x C to C. Suppose that for every s > to 
and X e C the differential inclusion u'{t) € F(t,u(t)), with initial condition u{s) = x, has a unique solution 
Ug^x ■ [s, oo) I— > C. The family U defined by U{t, s)x = Us^x{t) is an evolution system on C. If X is Hilbert 
space and F{t,x) — ^Atx, where {At} is a family of maximal monotone operators, then the corresponding 
[/ is a CES. ' □ 



Example 5 Take a strictly increasing unbounded sequence {(T„} of positive numbers and set i'{t) — max{n G 
N I cr„ < t}. Consider a family {F„} of functions from C into C and define U(t,s) = Y[n^l^u{s)+i -^"^ 
product representing composition of functions. Then U is an ES. If each Fn is Af„-Lipschitz and the product 
is bounded from above by M, then U is an M-LES. For instance, if F„ = (/ + A„)~-'^, where {An} 
is a family of m-accretive operators on C, then the piecewise constant interpolation of infinite products of 
resolvents defines a CES. □ 
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8.2 Almost-orbits and asymptotic equivalence 

Let V be an evolution system on C. A locally bounded trajectory of the form t V{t, s)x for s and x fixed 
is an orbit of V. A locally bounded function u : — > C is an almost-orbit of V if 

lim \\u{t + h) - V{t + h, t)u{t)\\ = miiformly in h>0. (30) 

t — *oo 

Orbits and almost-orbits have, essentially, the same asymptotic behavior. 

Note the relation and difference with the notion of asymptotic pseudotrajectories where the convergence is 
uniform on compact time intervals ( |151 Benaim and Hirsch], 116! Benaim, Hofbauer and Sorin]). The current 
concept is more demanding but will allow for more precise results (convergence rather than properties on 
the set of limit points). 

Theorem 70 Let V be an evolution system. For the weak topology assume either that V is Lipschitz or X 
is weakly complete (weak Cauchy nets are weakly convergen\\) . If every orbit of V converges weakly (resp. 
strongly), then so does every almost-orbit. 



Proof. For the strong topology, let u be an almost-orbit of V and let e > 0. By definition, there is 5 > 
such that 

\\u{t + h)- V{t + h, t)u{t)\\ < e/4 

for all /i > and t > S. Define C{S) = lim V{t, S)u{S) and choose T> S such that \\V{t, S)u{S) - CiS)\\ < 
e/4 for all t > T. Then 

\\u{t + h)- C(5)|l < \\u{t + h) - V{t + h, S)u{S)\\ + \\Vit + h, S)u{S) - C(5)|l < e/2 

for alH > T and all h> 0. Thus ||u(i') — u{t)\\ < e for all t,t' >T so that u{t) is Cauchy and converges. 
It is clear that this argument is valid for the weak topology if X is weakly complete. If it is not the case but 
V is L-Lipschitz, one defines C{s) = w — lim V{t, s)u{s) and verifies that 

t — ^oo 

sup ||C(s +p) — C{s)\\ < Lsnp \\u{s + p) — V{s +p, s)u{s)\\, 

p>0 p>0 

which tends to zero as s — *■ oo showing that C(s) converges strongly to some ^. Then one easily proves that 
u(t) converges weakly to C as t ^ oo. ■ 

A special case of Theorem [70] was proved in [49 , Passty] , when V is defined by a semigroup of contractions 
or if the almost-orbits are orbits of a semigroup of contractions. 

Theorem 71 Under the hypotheses of Theorem \70[ the conclusion remains valid if the word converges is 
replaced by converges in average. 

The proof of this result can be found in ^ Alvarez and Peypouquet] . 
Comments 

A similar result holds for almost-convergence (see ^ Alvarez and Peypouquet]), a concept developed in |4H 
Lorentz] that is stronger than convergence in average. It had been proved in [44[ Miyadera and Kobayasi] 
under supplementary assumptions: i) V is defined by a strongly continuous semigroup of contractions; ii) 
iS ^ 0; and iii) for the weak topology, X is weakly complete. □ 



*The spaces and , as well as all reflexive Banach spaces, have this property. It is not the case if X contains 
Co, though (see p. 88 in [391 Li and QuefFelec]). 
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Lemma 72 Let U and V he evolution systems and assume that for each r > 

lim sup sup \\U{t + h, t)z - V{t + h, t)z\\ = 

*^°°/i>0 \\z\\<r 

then every bounded orbit ofV is an almost-orbit of U and viceversa. 

Proof. Let v be an orbit of V such that ||f (i)|| < r for aU t. Then 

\\v{t + h)-U{t + h,t)v{t)\\ = \\V{t + h,t)v{t) -U{t + h,t)v{t)\\ 

< snp \\U{t + h,t)z-V{t + h,t)z\\ 

\\z\\<r 

and so v is an almost-orbit of U. ■ 



8.3 Continuous dynamics and discretizations 

The following results explain why in most cases the systems defined in the preceding sections converge under 
the same hypotheses. The proofs are considerably simplified if one assumes boundedness of the almost-orbits 
by virtue of Lemma [7H We shall give them in this case along with the references for more general settings. 
The following proposition gathers results from [37l Sugimoto and Koizumi] and [31] Giiler] . 

Proposition 73 Let A be a maximal monotone operator on H and let U and V be the evolution systems 
defined by the differential inclusion ([5]) and the proximal algorithm ([7|), respectively. Assume one of the 
following conditions holds: 

^) {K} e e \ e; or 

ti) A^df and {A„} ^ i\ 

Then every orbit of U is an almost-orbit of V and viceversa. 

Proof. Define i'{t) as in Example[5l If {A„} E P \ part i) in Corollary [17] gives 

oo 

\\u{t+s,t)z~vit+s,t)zr<3\\A°zr 

n—i'{t) 

and we conclude using Lemma [7^ For miboimded almost-orbits, see |371 Sugimoto and Koizumi], li A = df 
and {A„} ^ the proof is highly technical and can be found in [3T1 Giiler]. It also relies on part i) in 
Corollary [T7] but sharper estimations on ||A*'a;„|| and are needed. ■ 



Proposition 74 Let T he nonexpansive, set A = I — T and let U and W be the evolution systems defined 
by the differential inclusion ([5]) and Euler's discretization (|13p. respectively. Assume {A„} € \£^. Then 
every orbit of U is an almost-orbit of W and viceversa. 

Proof. The argument in the proof of part i) in Proposition [73] can be applied here as well, by virtue of 
inequality (fT4|) . ■ 

These properties allow for a better understanding of similar asymptotic behavior of the continuous and 
discrete processes: in general for weak convergence in average (Section 4), for weak convergence in the case 
of demi-positive operators (Section 5) and for strong convergence under addtitional geometrical hypotheses 
(Section 6). 
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8.4 Quasi-autonomous systems 

One of the advantage of this approach through ahnost-orbits is that it extends to non-autonomous systems. 



8.4.1 Continuous dynamics 

Recall that the solutions of the differential inclusion ([5]) define an evolution system U as in Example ID Let 
us consider quasi-autonomous versions of (O, namely 

- v{t) e Av{t) + ip{t) (31) 

and 

-ij{t) e Av{t) +e{t)v{t). (32) 

Proposition 75 If E L^(0,oo;X), then every function satisfying (I3ip is an almost- orbit of U . The same 
holds for every function satisfying ([32|) provided e G L^{0, oo; R). 



Proof. For the first part we follow [HI Miyadera and Kobayasi]. If v satisfies (|5T|) and i > we have 

\\v{t + s) - U{t + s, t)v{t)\\^ <2 f y{t + t)\\ \\v{t + r) - U{t + t, t)v{t)\\dT 



and so 

/•s /•oo 
\\v{t + S) ~U(t + S,t)v{t)\\ < J \\Lp{t + T)\\dT < \\ip{T)\\dT. 

On the other hand, let v satisfy ([5^ . Fix t and consider as above ■ip{s) = ^||C/(i + s,t)v{t) — v{t + s)|p. 
Using (C,C - > -jUW^ for all C,^ e -ff, we deduce ipis) < l\e{t + s)\\\U{t + s,t)v{t)\\'^ for almost every 
s > 0. Integrating from to s and observing that ip{0) = we obtain 

1 M f°° 

\\U{t + s,t)v{t)-v{t + s)f <-j^ \e{T)\\\U{t + T,t)v{t)f dT<— \e{T)\dT 

if V is bounded. ■ 



Comments 

In [TJ Alvarez], the author studies the problem 

M"(i)+7"'W+V$(w(t)) =0, (33) 

where $ is a convex function. He proves that if Argmin((f>) ^ 0, then each solution u{t) converges weakly 
to a minimizer of $ as i ^ oo and gives conditions for strong convergence. Later, in [6j Attouch and 
Czarnecki] the authors establish, among other results, that ii e the solutions of 

u"{t) + 7M'(t) + V$(M(t)) + e{t)u{t) = 0. (34) 

also converge weakly to minimizers of $. It turns out (see [4j Alvarez and Peypouquet]) that under this 
condition (e € L^) the solutions of (|34p are almost-orbits of the evolution system defined by ([33|) . 
This is an alternative way to prove the cited result from [6l Attouch and Czarnecki] and it shows that these 
tools building on almost-orbits to classify the asymptotic behavior through equivalence classes (continuous 
trajectories, proximal or Euler approximations, Tykhonov regularization, perturbations) can be applied to 
second-order systems as well. □ 
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8.4.2 Proximal sequences 

In a similar fashion one can prove any interpolation of a sequence {y-n} satisfying 

Un-i - 2/n e A„Ay„ + (l>n (35) 

or 

2/«-i - 2/« e XnAyn + enVn (36) 

is an almost-orbit of the evolution system U defined by the proximal scheme ([7]) as in Example [5] provided 
{(j)n} e t^{^\X) and {e„} £ £i(N;R+), respectively. 

For additional applications and examples see [U Alvarez and Peypouquet]. 



9 Concluding remarks 

It is useful to observe that there are two aspects related to the ideas of asymptotic equivalence discussed 
in the last section. In the first place, one can obtain sufficient conditions for a perturbed, regularized or 
discretized system to have the same asymptotic properties as the original one. The issue here is in terms 
of stability or regularity or computational purposes. On the other hand, if a given dynamics does not have 
some desirable asymptotic behavior, one can introduce pertubation in order to generate orbits having better 
properties. In this case, the tools of asymptotic equivalence give necessary condition for a perturbation to 
be effective. 

Observe that the trajectories defined by ([S]) only converge weakly in average. Even in the case where A — df, 
convergence is still weak and the limit depends on the initial point. One can get a better asymptotic behavior 
by forcing the system to stabilize in the direction of the origin. More precisely, consider a piecewise absolutely 
continuous function e : R+ — > R+ such that lim e{t) — 0. If e e L^(0, cx); R-|_) the system defined by ([32]) 

t — >oo 

will have the same asymptotic behavior as ([5]) by Proposition [75l If we expect the regularized system to 
have better properties we must consider e ^ £^(0, cx); R+). The following result is from \2T, Cominetti, 
Peypouquet and Sorin]: 

Proposition 76 Suppose v : R+ H satisfies 

-v{t) e Av[t) + e[t)v{t). 

with e (f: L"'^(0, cx); R+). Assume further that A — df or \£{t)\ dt < oo (finite total variation). Then 
lim v{t) = PsO. 

t — >QO 

Special cases of the preceding result had been proved earlier in [51] Browder], jSH Reich] and [51 Attouch 
and Cominetti]. A similar result for the second order appears in Attouch and Czarnecki]. 

Also, as we mentioned before, the trajectories defined by ([5]) need not be weakly convergent. If one applies 
the proximal point algorithm with stepsizes A„ € by Proposition 1731 the corresponding system will have 
the same asymptotic properties. In other words, the approximation is too good: "the discrete approximation 
mirrors the behavior of the differential equation too well" j25l Bruck, p. 29]. If one wishes to get a better 
(or different) behavior, it is necessary to consider A„ ^ This turns out to be fruitful because, in that case 
Theorem |48] guarantees weak convergence even when the operator is not demipositive (see also Example 3 
in Section 6). 

Acknowledgments 

The authors wants to thank Roberto Cominetti for his help during the preparation of this work. In particular 
his (unpublished) notes on "Evolution equations and monotone maps" were very helpful. 
S. Sorin acknowledges support from grant ANR-08-BLAN-0294-01 (France). 



42 



References 

[1] Alvarez F, On the minimizing property of a second order dissipative system in Hilbert spaces, SIAM J. 
Control Optim., 38 (2000), 1102-1119. 

[2] Alvarez F, Pcypouquct J, Asymptotic equivalence and Kobayashi-type estimates for nonautonomous 
monotone operators in Banach spaces, to appear in DCDS, (2009). 

[3] Alvarez F, Peypouquet J, Asymptotic almost-equivalence of abstract evolution systems, submitted 
(2008). 

[4] Alvarez F, Peypouquet J, Asymptotic almost-equivalence and applications, in preparation (2009). 

[5] Attouch H, Cominetti R, A dynamical approach to convex minimization coupling approximation with 
the steepest descent method, J. Diff. Equations, 128 (1996), 519-540. 

[6] Attouch H, Czarnccki MO, Asymptotic control and stabilization of nonlinear oscillators with non-isolated 
equilibria, J. Diff. Equations, 179 (2002), 278-310. 

[7] Baillon JB, Un theoreme de type ergodique pour les contractions non lineaires dans un espace de Hilbert, 
CRAS, 280 (1975), 1511-1514. 

[8] Baillon JB, Quelques proprietes de convergence asymptotique pour les semi-groupes de contractions 
impaires, CRAS, 283 (1976), A75-A78. 

[9] Baillon JB, Quelques proprietes de convergence asymptotique pour les contractions impaires, CRAS, 
283 (1976), A587-A590. 

[10] Baillon JB, Un exemple concernant le comportement asymptotique de la solution du probleme du/dt + 
dip{u) 9 0, J. Funct. Anal., 28 (1978), 369-376. 

[11] Baillon JB, "Comportement asymptotique des contractions et semi-groupes de contraction", These, 
Universite Paris 6, 1978. 

[12] Baillon JB, Brezis H, Una remarque sur le comportement asymptotique des semi-groupes non lineaires, 

Houston J. Math., 2 (1976), 5-7. 

[13] Barbu V, "Nonlinear semigroups and differential equations in Banach spaces" . Noordhoff, Lcyden, 1976. 

[14] Bauschke HH, Burke JV, Deutsch FR, Hundal HS, Vanderwerff JD, A new proximal point iteration 
that converges weakly but not in norm, Proc. Amer. Math. Soc, 133 (2005), 1829-1835. 

[15] Benai'm M, Hirsch MW, Asymptotic pseudotrajectories and chain recurrent flows, with applications, J. 
Dynamical Differential Equations, 8 (1996), 141-176. 

[16] Benaim M, Hofbauer J, Sorin S, Stochastic approximations and differential inclusions, SIAM J. Control 

Optim., 44 (2005), 328-348. 

[17] Benilan P, "Equations d'evolution dans un espace de Banach quelconque et applications" . These, Orsay, 
1972. 

[18] Brezis H, "Monotonicity methods in Hilbert spaces and some applications to nonlinear partial differential 
equations" . Contributions to Nonlinear Functional Analysis, ed. by H. Zarantonello, Academic Press, 
1971, 101-156. 

[19] Brezis H, "Operateurs maximaux monotones et semi-groupes de contractions dans les espaces de 
Hilbert" . North Holland Publishing Company, Amsterdam, 1973. 

[20] Brezis H, Lions PL, Produits infinis de resolvantes, Israel J. Math., 29 (1978), 329-345. 

[21] Browder FE, Nonlinear operators and nonlinear equations of evolution in Banach spaces, Proc. Symp. 
Pure Math, 18 (2) (1976), Amer. Math. Soc, Providence RL 

[22] Bruck RE, Asymptotic convergence of nonlinear contraction semigroups in Hilbert space, J. Funct. 
Anal, 18 (1975), 15-26. 



43 



[23] Bruck RE, On the weak convergence of an ergodic iteration for the solution of variational inequalities 
for monotone operators in Hilbert space, J. Math. Anal. AppL, 61 (1977), 159-164. 

[24] Bruck RE, On the almost- convergence of iterates of nonexpansive mappings in a Hilbert space and the 
structure of the w-limit set, Israel J. Math., 29 (1978), 1-17. 

[25] Bruck RE, Asymptotic behavior of nonexpansive mappings, Proc. Symp. Pure Math, Nonlinear Func- 
tional Analysis and Applications, 45 (1986), 1-47, Amer. Math. Soc, Providence RI. 

[26] Bruck RE, Reich S, A general convergence principle in nonlinear functional analysis. Nonlinear Anal., 
4 (1980), 939-950. 

[27] Cominetti R, Peypouquet J, Sorin S, Strong asymptotic convergence of evolution equations governed by 
maximal monotone operators with Tikhonov regularization, J. Diff. Equations, 245 (2008), 3753-3763. 

[28] Crandall MG, Liggett TM, Generation of semigroups of nonlinear transformations on general Banach 
spaces. Am. J. Math., 93 (1971), 265-298. 

[29] Crandall MG, Pazy A, Semi-groups of nonlinear contractions and dissipative sets, J Funct. Anal., 3 

(1969), 376-418. 

[30] Edelstein M, The construction of an asymptotic center with a fixed-point property, Bull. Amer. Math. 
Soc, 78 (1972), 206-208. 

[31] Giiler O, On the convergence of the proximal point algorithm for convex minimization, SIAM J. Control 
& Opt., 29 (1991), 403-419. 

[32] Giiler O, Convergence rate estimates for the gradient differential inclusion, Optim. Methods Softw., 20 
(2005), 729-735. 

[33] Hirano N, Nonlinear ergodic theorems and weak convergence theorems, J. Math. Soc. Japan, 34 (1982), 
35-46. 

[34] Hirsch F, "Families resolvantes, generateurs, cogenerateurs, potentiels". These, Orsay, 1971. 

[35] Kato T, Nonlinear semi-groups and evolution equations, J. Math. Soc. Japan, 19 (1967), 508-520. 

[36] Kobayashi Y, Difference approximation of Cauchy problems for quasi-dissipative operators and gener- 
ation of nonlinear semigroups, J. Math Soc. Japan, 27 (1975), 640-665. 

[37] Sugimoto T, Koizumi M, On the asymptotic behavior of a nonlinear contraction semigroup and the 
resolvent iteration, Proc. Japan Acad., 59 (1983), 238-240. 

[38] Komura Y, Nonlinear semi-groups in Hilbert space, J. Math. Soc. Japan, 19 (1967), 493-507. 

[39] Li D, Queffelec, H "Introduction a I'etude des espaces de Banach - Analyse et probabilites" . Cours 
specialises 12, Societe Mathematique de France, 2004. 

[40] Lions PL, line methode iterative de resolution d'une inequation variationnelle, Israel J. Math., 31 
(1978), 204-208. 

[41] Lorentz GG, A contribution to the theory of divergent sequences, Acta Math., 80 (1948), 167-190. 

[42] Martinet B, Regularisation d'inequations variationnelles par approximations successives, Rev. Frangaise 
Informat. Recherche Operationnelle , 4 (1970), 154-158. 

[43] Minty G, Monotone (nonlinear) operators in Hilbert space, Duke Math. J., 29 (1962), 341-346. 
On the monotonicity of the gradient of a convex function, Pacific J. Math., 14 (1964), 243-247. 

[44] Miyadera I, Kobayasi K, On the asymptotic behavior of almost-orbits of nonlinear contractions in 

Banach spaces. Nonlinear Anal., 6 (1982), 349-365. 

[45] Moreau JJ, Proprietes des applications "prox", CRAS, 256 (1963), 1069-1071. 

[46] Nevanlinna O, Reich S, Strong convergence of contraction semigroups and of iterative methods for 
accretive operators in Banach spaces, Israel J. Math., 32 (1979), 44-58. 



44 



[47] Opial Z, Weak Convergence of the sequence of successive approximations for nonexpansive mappings, 
Bull. Amer. Math. Soc, 73 (1967), 591-597. 

[48] Passty G, Ergodic convergence to a zero of a sum of monotone operators in Hilbert space, J. Math. 
Anal. AppL, 72 (1979), 383-390. 

[49] Passty G, Preservation of the asymptotic behavior of a nonhnear contraction semigroup by backward 
differencing, Houston J. Math., 7 (1981), 103-110. 

[50] Pazy A, "Semigroups of nonlinear contractions and their asymptotic behavior". Nonhnear Analysis and 
Mechanics: Heriot-Watt Symposium, vol III, 1979, Pitman, 36-134. 

[51] Pazy, A. On the asymptotic behavior of iterates of nonexpansive mappings in Hilbert space, Israel 
Journal of Mathematics, 26 (1977), 197-20. 

[52] Pazy, A. On the asymptotic behavior of semigroups of nonlinear contractions in Hilbert space, Journal 
of Functional Analysis, 27 (1978), 292-307. 

[53] Pazy, A. Remarks on nonlinear ergodic theory in Hilbert spaces, Nonlinear Analysis, Theory, Methods 

& Applications, 3 (1979), 863-871. 

[54] Reich S, Nonlinear evolution equations and nonlinear ergodic theorems, Nonlinear Anal., 1 (1977), 
319-330. 

[55] Reich S, Nonlinear ergodic theory in Banach spaces, Argonne National Lab. ANL-79-76 (1979). 

[56] Reich S, Weak convergence theorems for nonexpansive mappings in Banach spaces, J. Math. Anal. & 
App., 67 (1979), 274-276. 

[57] RockafcUar RT, Monotone operators and the proximal point algorithm, SIAM J. Control Optim., 14 
(1976), 877-898. 

[58] Shepilov MA, "On gradient and penalty methods in mathematical programming problems" . PhD thesis, 
Moscow, 1974. 

[59] Shor NZ, "Minimization methods for non- differ entiable functions" . Springer, Berlin, 1985. 

[60] Vigeral G, Evolution equations in discrete and continuous time for nonexpansive operators in Banach 
spaces, to appear in COCV, (2009). 



45 



